U.S.  ARMY  RESEARCH  INSTITUTE  for  the  BEHAVIORAL  and  SOCIAL  SCIENCES 


Approved  for  public  release;  distributiononiimittedk 


U.  s.  ARMY  RESEARCH  INSTITUTE 

FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 

A  Field  Operating  Agency  under  the  Jurisdiction  of  the 
Deputy  Chief  of  Staff  for  Personnel 


L.  NEALE  COSBY 

JOSEPH  ZEIDNER  Colonel,  IN 

Technical  Director  Commander 


Research  accomplished 

under  contract  to  the  Department  of  the  Army 
Applied  Psychological  Services,  Inc. 


notices 


pinal  disposition.  Thli  Researcn  Product  may  M  destroyed  whan  It  Is  no  longer  naadad.  P taasa  do  not 
return  it  to  the  U.S.  Army  Research  lnst..ute  for  the  Behavioral  and  Social  Sciences. 


note?  This  Research  Product  is  not  to  Oe  construed  as  an  official  Department  of  the  Army  document  In  its 
present  form. 


TTMPT.ASSTT'TFn 


SECURITY  CLASSIFICATION  OF  THIS  FAGE  (When  Data  Entered) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  REPORT  NUMBER  2.  GOVT  ACCESSION  NO. 

Research  Product  81-32 

3.  RECIPIENT'S  CATALOG  NUMBER 

4.  TITLE  (end  Subtitle) 

digital  behavioral  simulation-state-of-the-art 

AND  IMPLICATIONS 

5.  TYPE  OF  REPORT  A  PERIOD  COVERED 

Final  Technical 

S-  PERFORMING  ORG.  REPORT  NUMBER 

7.  AUTHORfa.) 

Arthur  I.  Siegel,  J.  Jay  Wolf 

S.  CONTRACT  OR  GRANT  HUMBERT*) 

MDA903-79-C-3Q13 

>.  PERFORMING  ORGANIZATION  NAME  ANO  ADDRESS 

Applied  Psychological  Services 

Science  Center 

Wayne,  PA  19087 

10.  PROGRAM  ELEMENT.  PROJECT,  TASK 
AREA  A  WORK  UNIT  NUMBERS 

2Q162717A790 

2Q263743A79A 

II.  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

US  Army  Research  Institute  for  the  Behavioral 
and  Social  Sciences,  5001  Eisenhower  Avenue, 
Alexandria,  VA  22333 

U.  REPORT  DATE 

June  1981 

13.  NUMBER  OF  PAGES 

99 

14.  MONITORING  AGENCY  NAME  A  AOORESSf//  dl  Horen  t  from  Controlling  Ollleo) 

IS.  SECURITY  CLASS,  (ol  Me  report) 

UNCLASSIFIED 

IS*.  DECLASSIFICATION/DOWNGRADING 
SCHEDULE 

IS.  DISTRIBUTION  STATEMENT  (ol  Mo  Report) 

Approved  for  public  release;  distribution  unlimited. 

17.  DISTRIBUTION  STATEMENT  (ol  (ha  ebotroct  entered  In  Block  20,  II  dltterent  front  Roport) 

IS.  SUPPLEMENTARY  NOTES 

IS.  KEY  WORDS  ( Continue  on  reeetee  oldo  It  nocoooorj  end  Identity  by  block  number ) 

{Simulation  System  Analysis 

Simulation  Model  Design  Review 

Human  Performance 

NETMAN 

20.  ABSTRACT  (Ceotieue  em  roeerem  otto  tt  neeeeee my  end  Identity  by  block  mmtber) 

"  This  report  presents  a  comprehensive  review,  analysis,  and  appraisal 
of  the  state-of-the-art  in  computer  simulation  models  in  which  human 
performance  characteristics  play  an  important  part.  Concepts  and  con¬ 

siderations  important  to  the  development  of  such  models  are  discussed  and 
examples  of  current  models  are  presented  to  provide  an  overview  of  the 
status  of  the  digital  simulation  field  relative  to  behavioral  simulation. 

DO  I  j2“b  1473  EDITION  OF  I  NOV  SS  IS  OBSOLETE 

J**'”  i  _ UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  FAGE  (Winn  Data  E niered) 


SECURITY  CLASSIFICATION  of  THIS  RAOEfWh«n  Datm  Sntm d) 


Item  20  (Continued) 


Methods  which  have  been  or  could  be  used  in  predicting  and,  or  accounting 
for  human  effects  in  Army  system  performance  are  identified  and  defined. 
Problems  in  model  design  are  treated  -and  the  trade-offs  of  cost  versus 
benefit,  which  characterize  the  models  and  are  associated  with  current 
models,  are  discussed.  Future  trends  in  behavioral  modeling  are  also 
projected,  along  with  recommendations  relative  to  the  development  and 
maintenance  of  current  Army  models. 


SECURITY  CLASSIFICATION  OF  THIS  PAOE(TFh*n  DM*  EnfanMf) 


Research  Product  81-32 


DIGITAL  BEHAVIORAL  SIMULATIONS 
STATE-OF-THE-ART 
AND  IMPLICATIONS 


Arthur  I.  Siegel,  J.  Jay  Wolf 
Applied  Psychological  Se’-vices,  Inc. 


Submitted  by: 

John  F.  Hayes,  Acting  Chief 
TRAINING  TECHNICAL  AREA 


Accession  For  j 

NTIS  GRA&I 

DTIC  TAB 

U:>, announced 

Ju:t if  j  crt ion 

9 

n 

Pv„ 

|  Di. 

1  *  , 

' .  t  •  .  >  . .  n 

?■  r*  o  s 

...  ...  ,l' 
i 

\Al  1 

0  2* 

Approved  by: 

Milton  S.  Katz,  Acting  Director 
TRAINING  RESEARCH  LABORATORY 


U.S.  ARMY  RESEARCH  INSTITUTE  FOR  THE  BEHAVIORAL  AND  SOCIAL  SCIENCES 
5001  Eisenhower  Avenue,  Alexandria,  Virginia  22333 

Office,  Deputy  Chief  of  Staff  for  Personnel 
Department  of  the  Army 


June  1981 


Army  Project  Number  Human  Performance  Effectiveness  and  Simulation 

2Q162717A790  Education  and  Training 

2Q263743A794 


Approved  for  public  reiwsc,'  distribution  unlimited. 


iii 


83 


A 

— 


3 

K- 

K 

l 

r-. 

fv 


FOREWORD 


The  accurate  simulation  of  human  behavior  in  known  situations  provides 
increased  ability  to  understand  and  to  predict  behavioral  outcomes  under 
unknown  or  hypothetical  circumstances.  Concepts  and  considerations  impor¬ 
tant  to  the  development  of  realistic  predictive  behavioral  simulations  are 
presented  in  this  report  to  encourage  the  additional  development  of  com¬ 
puter  simulation  techniques.  The  realism  and  predictive  power  of  current 
Army  system  models  could  be  sharply  Increased  if  human  behavioral  simu¬ 
lation  were  to  be  incorporated  into  these  models. 


Within  this  report,  methods  which  have  been  used  or  could  be  used 
in  accounting  for  and  predicting  human  effects  in  Army  system  performance 
are  identified.  Problems  in  model  design  are  treated  and  the  costs  and 
benefits  which  characterize  a  number  of  the  models  are  discussed. 

This  report  was  compiled  as  a  part  of  Army  Project  2Q162717A790  and 
2Q263743A794. 


DNER 

Technical  Director 
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EXECUTIVE  SUMMARY 


Human  behavioral  considerations  are  believed  to  be  essential  in¬ 
gredients  in  Army  planning.  Yet,  behavioral  modeling  through  computer 
simulation  techniques  has  been  employed  in  only  a  limited  number  of 
Army  computer  simulation  models. 


The  realism  and  the  predictive  power  of  current  Army  system 
models  could  be  sharply  increased  if  human  behavioral  simulation  was 
incorporated  into  the  system  models.  Limited  prior  experience  in  the 
Army  suggests  the  advantage  and  potential  of  behavioral  modeling. 


Methods  and  Results 

Behavioral  simulation  modeling,  defined  as  a  representation  of 
behavior  and  behavioral  influence  implemented  on  a  digital  computer  so 
as  to  allow  control  or  prediction  of  an  event  or  event  sets,  is  reviewed. 
Current  behavioral  models  are  described  in  sufficient  detail  to  allow  some 
comprehension  of  the  simulation  detail  and  comprehensiveness  currently 
available.  Examples  are  given  of  behavioral  simulations  which  might  be 
incorporated  into  current  Army  computer  simulation  models.  Pervasive 
problems  in  human  behavioral  simulation  are  reviewed  and  methods  for 
meeting  these  problems  are  presented.  These  include  such  diverse  issues 
as  the  type  of  model  to  construct,  time  and  event  advance  techniques,  in¬ 
put  data  requirements,  data  availability,  required  level  of  input  data  de¬ 
tail,  choice  of  programming  language,  transportability,  model  validation, 
generality,  the  model-user  interface,  cost/ effectiveness  considerations, 
individual  differences  representation,  and  parameter  estimation  and  choice. 


Implications 


An  increase  in  the  use  of  behavioral  simulation  relative  to  evalua¬ 
tion  of  the  design  and  use  of  Army  equipment  systems  and  personnel  sub¬ 
systems  seems  warranted.  To  this  end,  available  behavioral  simulation 
modules  should  be  tailored  so  that  they  can  be  employed  to  moderate  the 
results  from  or  to  interact  with  equipment  system  models  so  as  to  pro¬ 
duce  output  which  considers  the  human  component  in  the  person-machine 
integral.  New  behavioral  modules  which  are  pertinent  to  the  Army  situa¬ 
tion  should  also  be  developed  along  with  the  appropriate  data  base  for  sup¬ 
porting  such  modules.  Such  an  effort  should  be  systematic  and  provide  im¬ 
mediate  (short  term),  and  mid  term  (about  five  years)  end  products.  The 
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work  should  be  based  on  and  drawn  from  a  user  needs/ requirements  sur¬ 
vey  which  pinpoints  the  type  of  behavioral  variables  which  are  most  salient 
to  Army  needs  and  the  type  of  output  required  by  the  Army  user. 
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I.  ROLE  OF  BEHAVIORAL  MODELS 


Introduction 


Modeling  of  systems  and  events  has  emerged  over  the  years  as  a 
fundamental  tool  for  system  evaluation.  This  report  is  concerned  with  a 
specific  category  of  models — digital  simulation  models --and  with  a  spe¬ 
cific  class  of  models  within  the  digital  simulation  category- -stochastic 
digital  simulation  models  of  human  behavior. 


Advantages  of  Behavioral  Models 

Stochastic  simulation  models  of  behavior  have  become  possible,  in 
part,  because  of  the  advent  of  the  high-speed  digital  computer.  The  cap¬ 
ability  of  the  computer  to  perform  a  myriad  of  calculations  in  very  short 
time  periods  along  with  its  decision  making  capability  makes  possible  the 
accomplishment  of  processes  which  heretofore  were  impractical  if  not 
impossible. 

A  second  set  of  reasons  for  the  increased  emphasis  on  (i.  e. ,  ad¬ 
vantages  of)  behaviorally  oriented  digital  simulation  models  lies  in  their 
ability  to  allow  simulations  of  systems  and  conditions  which,  if  examined 
or  tested  directly  would:  (1)  be  dangerous  when  performed  through  physi¬ 
cal  simulation  means,  (2)  be  costly  in  terms  of  commitment  of  large  num¬ 
bers  of  people  or  of  large  quantities  of  equipment,  and  (3)  require  long 
periods  of  time  (i.  e.,  years)  to  set  up  and  accomplish.  Digital  simulation 
also  allows  the  capability  for  highlighting  potential  problems  in  an  actual 
system  which  has  not  yet  been  implemented,  or  in  a  situation  or  set  of  con¬ 
ditions  which  has  never  occured  in  an  implemented  system. 

Digital  simulation  of  a  person-machine  system  is  also  attractive 
when  the  actual  system  "is  so  fully  occupied  that  experimentation  with 
changes  in  equipment,  personnel  policy,  or  resource  assignment  rules 
may  be  impractical,  expensive,  dangerous,  or  unlawful"  (Siegel  &  Wolf, 
1969). 

Finally,  such  models  provide  a  useful  methodological  tool  to  those 
behavioral  and  engineering  scientists  who  are  involved  with:  (1)  the  quan¬ 
tification  and  enhancement  of  human  capability  and  its  inherent  variability, 
and  (2)  the  related  issue  of  the  contributions  of  human  unreliability  to  total 
system  unreliability. 
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Definitions  of  Models 

Computer  models  have  been  variously  defined.  Examples  of  cur¬ 
rent  definitions  are: 

A  computer  simulation  is  a  logical-mathematical  rep¬ 
resentation  of  a  concept,  system,  or  operation  pro¬ 
grammed  for  solution  on  a  high  speed  electronic  com¬ 
puter  (Martin,  1968). 

A  simulation  model  can  be  defined  as  an  abstraction 
of  some  real  system  that  can  be  used  for  purposes 
of  prediction  and  control  (Naylor  et  al. ,  1966). 

. . .  form  a  picture  of  (the  system's)  behavior  by  sam¬ 
pling  from  all  the  ways  it  might  behave  (Kendell, 

1968). 

The  (simulation  model)  produces  outputs  resembling 
those  observed  in  the  real  world,  and  inspires  con¬ 
fidence  that  the  real  causal  process  has  been  accu¬ 
rately  represented  (Dutton  and  Starbuck,  1971). 

A  simulation  model  is  an  operator  that  generates  a 
set  of  variables  X,  given  a  set  of  variables  Y,  such 
that:  (a)  the  sets  X  and  Y  represent  characteristics 
of  the  referent  situation,  (b)  the  set  X  is  indistinguish¬ 
able  with  respect  to  an  explicit  criterion  from  the  cor¬ 
responding  characteristics  of  the  referent  situation, 
and  (c)  the  operator  itself  represents  the  causal  proc¬ 
ess  of  the  referent  situation  (Starbuck,  1971). 

The  essence  of  these  definitions  seems  to  be  that  computer  simu¬ 
lation  attempts  to  mimic  or  to  represent  some  aspect  of  real  life  and  that 
the  simulation  process  is  embodied  in  the  form  of  a  high  speed  digital  com 
puter  program. 

A  behavioral  simulation  model  attempts  to  represent  logically  and 
mathematically  some  category,  type,  or  class  of  human  behavior.  The 
class  of  human  behavior  of  concern  in  behavioral  models  is  the  psycholog¬ 
ical  response,  and  to  some  extent,  the  physiological  response.  The  behav 
ioral  model  is  concerned  with  person-machine,  person-person,  and  per¬ 
son-environment  relationships  and  with  their  interactions,  i.  e. ,  with  the 
performance  of  individuals  and  groups  under  varying  conditions  due  to  the 
environment,  training,  operational  doctrine,  characteristics  of  equipment 
systems,  and  individual  capabilities. 
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Mere  representation  is  not  a  sufficient  goal  in  itself  for  a  behav¬ 
ioral  model.  To  be  useful  for  more  than  descriptive  purposes,  the  rep¬ 
resentation  should  be  of  such  a  nature  that  it  allows  manipulation  of  ex¬ 
trinsic  (situational/ environmental/ equipment)  or  intrinsic  (individual  and 
group)  variables  so  as  to  allow  determination  of  the  effects  of  the  manip¬ 
ulation  on  some  output  measure  or  on  some  other  variable  which  exerts 
an  affect  on  the  output. 

Hence,  we  define  a  behavioral  computer  simulation  model  as  a 
representation  of  behavior  and  behavioral  influences  implementated  on 
a  digital  computer  so  as  to  allow  control  or  prediction  of  an  event,  or 
event  sets.  This  definition  emphasizes  both  the  structural  and  the  utility 
aspects  of  a  behavioral  simulation  model. 


Models  versus  Theories 


While  a  model  will  often  be  based  on  theory,  a  model  of  human  be¬ 
havior  or  of  some  aspect  of  behavior  is  not,  per  se,  a  theory  of  behavior. 
The  two  should  not  be  confused.  Table  1-1  compares  and  contrasts  mod¬ 
els  and  theories.  A  model  possesses  a  different  purpose  than  a  theory: 

•  Feigl  (1949)  proposed  that  the  purpose  of  a  theory  is  to  state 
functional  relationships.  While  a  model  may  include  function¬ 
al  relationships  within  its  structure,  the  goal  of  simulation 
modeling,  as  stated  above,  is  to  allow  for  prediction  or  con¬ 
trol  of  the  effects  of  manipulating  extrinsic  or  intrinsic  vari¬ 
ables  on  an  output  measure. 

•  Chapanis  (1961),  holds  that  models  are  to  be  judged  on  the 
basis  of  utility  while  the  test  of  a  theory  rests  on  validity. 

The  "utility"  of  a  model,  to  us,  means  the  extent  to  which 
the  output  assists  the  decision  maker  in  reaching  a  decision. 

•  Because  they  are  fundamentally  representational  in  nature, 
models  are  descriptive  in  content.  Because  the  goal  of 
theories  is  to  state  functional  relationships,  as  a  minimum, 
they  must  rely  on  some  type  of  correlational  content. 

•  Theories  may  postulate  unknown  or  intervening  variables  of 
unknown  or  partially  known  dimensions.  In  contrast,  each 
variable  in  a  simulation  model  must  be  defined,  be  scalable, 
and  its  relationship  to  other  variables  clearly  specified. 

•  Whereas  models  are  highly  quantified  so  that  specific  repre¬ 
sentations  can  be  constructed  with  precision,  in  theories  quan¬ 
tification  is  not  essential. 


L&LZ. 


/L>*fcfrArfc Vtili'vM '!'•»$?  iQlifli»aUSt (  U*4« Ji  i'L< X£tf  tt » ub>  -1.  fc.  v. i*-'  UtLsil ~ 


Table  1-1 


Comparison  of  Models  and  Theories 


Behavioral  Model 


Theory 


Purpose 


Predict  or  control  behav-  Describe  functional 

ioral  implications --"What  relationships --"How 

happens  if"  it  works" 


Criteria  of 
Acceptance 


Utility  or  assistance  in 
decision  making 


Validity 


Content 


Descriptive 


Correlational 


Variables 


Measurable/  scalable 


May  be  hypothetical 


Quantification 


High 


Optional 


Generality 


From  full  to  limited 


Full 
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A  behavioral  model  may  be  highly  specific  or  general  for  a  class 
of  behavior.  Theories  attempt  to  cover  as  general  a  sphere  of  interest  as 
possible* 

Utility  of  Behavioral  Models  to  the  Army 

Models  in  general  and  behavioral  models  in  particular  can  help  the 
Army  weapon  system  and  the  personnel  subsystem  developers  to  answer 
a  variety  of  questions  which  can  not  be  easily  answered  through  other  meth¬ 
ods.  The  upper  part  of  Figure  1-1,  which  was  originally  suggested  by 
Haythorne(1963),  places  simulation  models  into  perspective  relative  to  the 
fidelity  of  various  available  evaluative/ predictive  techniques.  As  one  pro¬ 
ceeds  along  the  time  continuum,  the  techniques  approach  reality  to  a  great¬ 
er  extent.  Hence,  the  fidelity  of  computer  simulation  falls  between  deter¬ 
ministic  analysis  and  physical  simulation.  The  lower  portion  of  Figure  1-1 
portrays  the  DoD  system  development  cycle  from  the  basic  research  phase 
through  exploratory  development  to  full  scale  production  and  operational 
deployment.  Different  evaluative/ predictive  techniques  assume  appropri¬ 
ateness  during  various  stages  in  the  equipment  system  development  cycle. 
Qualitative  estimates  of  system  effectiveness  are  viewed  as  sufficient  dur¬ 
ing  the  basic  research  phase  of  system  development.  As  the  system  de¬ 
sign  matures  and  hardens  in  the  exploratory  development  and  the  advanced 
development  stages,  deterministic  and  computer  simulation  evaluative 
techniques  play  a  dominant  role.  In  the  more  advanced  stages  of  the  develop 
ment,  physical  simulation  and  various  field  operational  and  technical 
evaluations  play  a  more  important  role. 

In  this  context,  behavioraliy  oriented  computer  simulation  is  in  a 
position  to  provide  the  system  developer  with  answers  to  a  wide  variety 
of  questions,  while  a  system  is  early  in  the  development  phase.  Ques¬ 
tions  can  be  answered  such  as: 

•  What  are  the  quantitative  personnel  requirements? 

•  What  are  the  qualitative  personnel  requirements? 

Where,  during  system  utilization,  are  operators 
most  overloaded?  Underloaded? 

•  How  will  cross  training  improve  system  effective¬ 
ness? 

•  Are  the  system  operators  able  to  complete  all  of 
their  required  tasks  within  the  time  allotted? 

•  Where  in  the  task  sequence  are  operators/ groups 
likely  to  fail  most  often?  Least  often? 


FIGURE  1-1.  RELATIONSHIP  BETWEEN  VARIOUS  SYSTEM  EVALUATIVE  TECHNIQUES  AND  DoD  SYSTEM 
DEVELOPMENT  CONTINUUM. 


•  In  which  state(s)  of  the  system  is  the  "human” 
subsystem  (and/or  components  thereof)  least 
reliable  and  why? 

•  How  will  task  restructuring  or  task  realloca¬ 
tion  affect  system  effectiveness? 

•  How  much  will  performance  degrade  when  the 
system  operators  are  fatigued?  Stressed? 

•  How  will  various  environmental  factors  (e.  g. , 
heat,  light,  terrain)  affect  total  man-machine 
system  performance? 

•  To  what  extent  will  system  effectiveness  im¬ 
prove  or  degrade  if  more  or  le^s  proficient 
operators  are  assigned? 

•  How  do  group  factors  such  as  morale  and  co¬ 
hesion  affect  system  performance? 

Computer  simulation  provides  the  quantitative  data  so  that  analysts 
can  develop  answers  to  such  questions  while  systems  are  in  the  exploratory 
as  well  as  the  advanced  development  stages.  The  answers  to  such  questions 
can  then  be  used  for  Army  system  redesign  or  modification  early  in  the  de¬ 
velopmental  cycle.  Once  the  design  changes  have  been  decided  on,  a  series 
of  computer  simulations  can  be  completed  representing  the  modified  system 
to  predict  the  extent  of  the  improvement  to  be  brought  about  by  the  modified 
system. 

A  corollary  to  and  extension  of  the  uses  of  computer  simulation  dis¬ 
cussed  above  is  the  employment  of  computer  simulation  to  compare  the  ef¬ 
fectiveness  of  alternate  system  concepts.  Here,  two  or  more  Army  system 
concepts  are  modeled  with  the  end  result  in  mind  of  selecting  the  "best"  con¬ 
cept  for  further  development. 

In  the  general  case,  possibly  the  greatest  advantage  of  models  to  the 
Army  lies  in  their  ability  to  provide  the  basis  for  system  oriented  tradeoffs 
during  the  early  stages  of  a  system's  development.  Figure  1-2  presents  a 
hypothetical  representation  of  the  gain  in  system  effectiveness  (as  estimated 
by  computer  simulation)  when  various  amounts  of  money  are  invested  either 
in  physical  design  improvement  or  system  operator/ maintainer  training  im¬ 
provement.  In  the  illustrative  example,  if  less  than  about  300  cost  units  are 
available,  the  system  manager  would  be  well  advised  to  invest  most,  if  not 
all,  of  his  available  funds  in  training  rather  than  physical  redesign.  In  the 
450  cost  unit  area,  physical  design  improvement  produces  an  increase  in 
system  effectiveness  that  equals  the  gain  to  be  anticipated  from  increased 
training  emphasis. 


■  - — !U;a ;  '  •  A  ; 
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A  EFFECTIVENESS  30 
IN  PERCENT 
INCREASE  29 

OVER 

BASELINE  201 


TRAINING 


PHYSICAL 

REDESIGN 


INVESTMENT  IN  COST  UNITS 


Figure  1-2.  Hypothetical  example  of  tradeoff  between  training  and 
physical  equipment  redesign  as  indicated  by  simulation 
results. 


When  more  than  450  costs  units  are  available  for  improvement, 
these  data  show  the  best  investment  to  be  in  a  physical  redesign.  Note 
that  the  asymptotic  situation  is  achieved  for  both  alternatives  in  the  range 
of  500-600  cost  units.  Exemplary  of  the  type  of  decision-enabling  situation 
which  is  produced  by  simulation  is  the  not-so -obvious  results  generated 
from  the  Figure  1-2  data  which  are  shown  in  Table  1-2.  For  each  level  of 
funding  available  for  system  improvement.  Table  1-2  shows  the  way  to 
greatest  payoff: 

0-300  cost  units  -  buy  training 

450  cost  units  -  buy  training  or  physical  redesign 
500  cost  units  -  buy  physical  redesign. 
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Table  1-2  also  shows  that  no  advantage  can  be  gained  by  applying  more 
than  1200  cost  units  and  that  the  largest  payoff  in  terms  of  A  effective¬ 
ness  per  unit  funding  applied,  is  inthe  200  cost  unit  range  (see  *  Table 
1-2). 

Table  1-2 

Values  of  A  Effectiveness  Resulting  from  the 
Best  Choices  of  Funds  Application  for  Given 
_ Amounts  of  Funds  Availability _ 


If  this  number  and  these  funds  were 


of  cost  units 
were  the  avail¬ 
able  funding  for 
improvements 

divided  among: 

Physical 

Redesign  Training 

the  resulting 

A  effective¬ 
ness  would  be: 

The  ratio  A 
effectiveness/ 
cost  unit  is 
then: 

100 

0 

100 

8 

.080 

200 

0 

200 

18 

*.  090 

300 

0 

300 

23 

.077 

400 

0 

400 

26 

.065 

450 

0 

450 

27 

.  060 

450 

450 

0 

27 

.060 

500 

500 

0 

32 

.064 

600 

500 

100 

40 

.067 

700 

500 

200 

50 

.071 

800 

500 

300 

55 

.069 

900 

500 

400 

58 

.064 

900 

600 

300 

58 

.064 

1000 

600 

400 

61 

.061 

1100 

600 

500 

62 

.062 

1200 

600 

600 

63 

.063 

Purpose  of  Behavioral  Simulation  Models 

The  major  purpose  of  simulation  models  in  the  military  situation 
is  to  help  decision  makers  to  make  decisions.  In  this  role,  simulation 
models  provide  a  quantitative  information  data  base  for  decision  making 
that  is  usually  not  available  from  other  sources.  From  this,  it  follows 
that  the  ultimate  test  of  the  utility  of  a  computer  simulation  model  is  the 
extent  to  which  it  provides  unique  information  or  information  at  a  quality 
level  that  is  not  available  from  other  sources. 
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If  the  decision  involves  the  system  personnel  or  the  interaction 
of  the  personnel  with  the  equipment,  a  behavioral  simulation  model  is  re¬ 
quired.  A  model  of  the  physical  system  is  inadequate  for  such  purposes 
if  the  human  performance  element  is  missing  from  the  simulation.  Ac¬ 
cordingly,  the  behavioral  simulation  model  will  provide  personnel  subsys¬ 
tem  oriented  information  (e,  g. ,  effects  of  varying  manning,  skill  level, 
training,  time  stress,  situational  stress,  leadership  style,  motivation  on 
system  performance)  which  forms  a  partial  basis  for  decision  making. 

Model  Validity 

Note  that  the  model  utility  premise  ignores  questions  of  model 
validity.  The  validity  issue  is  believed  to  be  an  important  (even  critical), 
but  secondary,  issue  in  simulation  model  development  and  application. 

While  some  validity  represents  a  necessary  ingredient  in  any  model,  it  is 
quite  possible  to  have  a  highly  valid  model  which  yields  little  useful  infor¬ 
mation  for  decision  making  purposes.  Conversely,  a  model  of  moderate 
validity  may  provide  the  only  available  data  thus  allowing  the  decision  mak¬ 
ing  process  to  proceed  on  an  empirical  basis  rather  than  on  the  basis  of 
intuition  alone. 

Scope  of  the  Present  Report 

The  present  report's  subsequent  chapters  attempt  to  set  behavior¬ 
al  simulation  into  focus.  To  this  end.  Chapter  n  presents  various  behav¬ 
ioral  models.  The  chapter  attempts  to  show  the  diversity  of  the  field,  the 
current  state-of-the-art,  and  how  current  Army  system  models  might  ben¬ 
efit  from  the  inclusion  of  behavioral  models.  Chapter  III  discusses  a  num¬ 
ber  of  pervasive  issues  in  behavioral  modeling  through  computer  simula¬ 
tion.  Chapter  IV  assesses  the  current  status  of  behavioral  models  and  pro¬ 
jects  future  trends  in  the  field. 


II.  CURRENT  BEHAVIORAL  MODELS 


There  is  now  on  hand  a  considerable  body  of  experience  with  sim¬ 
ulation  models.  Such  models  have  been  developed  both  within  the  Army 
and  elsewhere  to  simulate  a  variety  of  behavioral  effects  on  system  per¬ 
formance. 


Examples  of  Behavioral  Models 


Early  Models 

The  first  integrated  attempt  at  behavioral  modeling  on  the  basis  of 
high  speed  computer  applications  is  believed  to  be  that  of  Siegel  and  Wolf 
(1969).  This  work  evolved  from  a  requirement  for  a  method  for  evaluat¬ 
ing  the  work  load  placed  on  operators  in  person-equipment  systems. 

Siegel  and  Wolf  constructed  an  event  sequenced  simulation  in  which  the  in¬ 
dividual  action  elements  (subtasks)  of  a  task  performed  by  either  one  or 
two  operators  are  successively  simulated.  To  introduce  the  variability 
inherent  in  individual  behavior,  Siegel  and  Wolf  specified  that  each  indiv¬ 
idual  response  time  to  complete  a  subtask  be  selected  stochastically. 

They  also  simulated  through  probabilistic  methods  the  branching,  looping, 
waiting,  and  Fubtask  repetition  inherent  in  the  performance  of  any  task. 

A  major  feature  of  this  early  model  was  simulation  of  the  reactions  of  the 
operators  to  time  stress.  This  feature  modifies  the  simulated  operators 
response  time  and  success  probability  as  a  function  of  the  time  remaining 
to  complete  a  task  and  an  individual  operator  stress  tolerance  input  para¬ 
meter  value. 

As  the  behavioral  modeling  art  progressed  and  confidence  in  its 
power  increased,  more  variables  and  variables  of  increased  complexity 
have  been  included  in  such  simulations.  For  example,  one  Army  Research 
Institute  battle  simulation  model  (Siegel,  Wolf,  Ozkaptan,  &  Schorn,  1980) 
includes  the  effects  on  performance  of  "physical"  variables  such  as  light 
level,  terrain  advantage,  and  enemy/friendly  personnel  strength  ratio. 
Other  recent  models  have  included  simulation  of  the  effects  of  such  psy¬ 
chological  variables  as  group  cohesiveness,  group  morale,  leadership 
expectation,  and  learning.  The  NETMAN  model  of  the  Army  Research 
Institute  for  the  Behavioral  and  Social  Sciences  includes  level  of  aspira¬ 
tion  and  a  decision  making  psychological  variable.  Table  2-1  lists  some 
of  the  behavioral  simulation  models  which  have  been  reported  in  the  lit¬ 
erature. 
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The  diversity  of  categories  and  techniques,  together  with  even  a 
cursory  review  of  Table  2-1,  indicates  that  a  wide  variety  of  models  has 
been  developed  and  reported.  Perhaps  the  time  has  arrived  to  focus  on 
the  development  of  fewer  high  quality  models  as  opposed  to  a  proliferation 
of  models  of  unknown  quality. 


Combat  versus  Behavioral  Models 


When  one  is  concerned  with  modeling  in  the  Army  context,  it  be¬ 
comes  important  to  distinguish  between  "combat"  models  and  "behavioral" 
models.  To  our  way  of  thinking,  combat  models  simulate  the  physical  as¬ 
pects  of  a  combat  situation.  They  might  include,  for  example,  variables 
such  as  the  type  of  weapons  available  to  each  opposing  force,  the  terrain, 
the  readiness  condition  of  the  equipment,  the  predicted  mean  time  between 
equipment  failures,  availability  of  reserve  forces,  and  the  like.  As  such, 
combat  models  come  to  grips  with  many  of  the  variables  which  exert  a  con¬ 
siderable  effect  on  combat  outcome. 

Behavioral  or  psychological  models,  on  the  other  hand,  simulate 
or  at  least  consider  the  effects  of  internal  and  environmental  variables  on 
the  performance  of  the  persons  who  operate  and  maintain  the  weapon  sys¬ 
tems  and  who  implement  the  battle  plan.  Accordingly,  behavioral  models 
or  behavioral  modules  can  serve  to  affect  the  output  of  combat  models  as 
a  function  of  the  human  element  in  the  person-equipment  system.  Total 
system  performance  is  then  considered  to  be  a  function  of  both  the  human 
and  the  equipment  elements  of  the  system.  Thus,  simulating  total  system 
performance  requires  an  integration  of  behavioral  and  combat  (physical) 
elements. 


Specific  Behavioral  Traits  Modeled  and  Their  Logic 

Some  further  concept  of  the  extent  and  methods  of  behavioral  model¬ 
ing  can  be  obtained  through  an  understanding  of  the  logic  of  some  of  the  be¬ 
havioral  variables  which  have  been  modeled  previously.  Modeling,  by  def¬ 
inition,  is  a  representation.  Accordingly,  there  must  be  some  understand¬ 
ing  of  the  psychological  or  behavioral  process  to  be  represented  by  a  model 
before  the  model  may  be  developed.  To  this  end,  the  behavioral  modeling 
process  usually  starts  with  some  sort  of  literature  analysis  to  isolate  the 
variables  important  to  the  process  to  be  modeled.  Often,  the  literature  in¬ 
dicates  more  salient  variables  than  the  modelist  wishes  to  include  in  his 
model.  In  this  case,  a  choice  must  be  made  among  the  available  variables. 
Table  2-2  lists  a  set  of  criteria,  employed  by  the  present  authors,  which 
must  be  more  or  less  satisfied  before  including  a  variable  within  a  model. 
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The  following  sections  present  examples  of  various  behavioral  sim¬ 
ulations.  The  simulations  were  selected  to  provide  some  concept  of  the 
scope  and  thrust  of  current  behavioral  simulations.  A  cognitive  (decision 
making),  motivational  (level  of  aspiration),  operator  characteristic  (phys¬ 
ical  capacity),  and  a  visual  recognition  (perceptual)  simulation  are  present 
ed.  Each  of  these  was  drawn  from  and  constituted  a  part  of  a  total  or  larg 
er  simulation. 


Decision  Simulation- -Cognitive  Example 


A  decision  module  was  developed  (Siegel,  Wolf,  &  Williams,  1978) 
to  simulate  the  operator's  decision  processes  involved  in  an  advanced 
electronic  imagery  system.  The  simulation  logic  follows  from  Simon  and 
Newell's  problem  solving  theory  (Newell  &.  Simon,  1972;  Simon  &.  Newell, 
1971)  but  expands  on  that  conceptualization  by  considering  task  complexity, 
decision  utility,  operator  ability,  stress,  and  Bayesian  concepts.  The 
Simon-Newell  theory  describes  the  problem  solver  as  stepping,  node-by¬ 
node,  through  the  problem  space  until  a  solution  (i.e. ,  final  decision)  is 
reached.  The  node  stepping  represents  the  decision  process  where  each 
step  involves  data  collection,  analysis,  and  evaluation  and  the  problem 
space  represents  the  size  and  structure  of  the  decision  task.  The  end  re¬ 
sult  of  the  simulation  is  an  indication  of;  (1)  the  correctness  of  the  deci¬ 
sion,  and  (2)  the  time  required  for  the  decision  making. 

The  decision  subroutine  was  based  on  decisions  involving  up  to 
five  decision  alternatives  (one  and  only  one  of  which  is  correct)  and  six 
nodes  (for  a  total  of  11  states).  The  representation,  as  shown  in  Figure 
2-1,  may  be  viewed  as  a  hexagonal  structure  which  may  be  initially  en¬ 
tered  at  any  node.  From  any  node,  11  choices  are  possible:  stepping  to 
one  of  the  other  five  nodes,  remaining  at  the  node,  or  stepping  to  a  solu¬ 
tion  state.  Stepping  to  a  solution  state  completes  the  stepping  process. 

Decision  time,  within  the  simulation,  is  calculated  as  a  function 
of  task  complexity,  stress  on  the  operator,  and  number  of  steps  to  reach 
a  solution.  Decision  correctness  is  determined  by  matching  the  solution 
reached  (via  the  stepping  process)  to  a  given  (input)  correct  solution. 
Within  the  step  process,  the  step  probability  values,  initially  supplied  as 
input,  are  affected  by;  (1)  operator  ability,  (2)  utility,  and  (3)  a  Bayesian 
process. 
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Table  2-2 

List  of  Criteria  Important  for 
Deciding  Whether  or  Not  to  Include  a  Variable 


AN  ACCEPTABLE  OR  PREFERRED  VARIABLE  IS  ONE  .  .  . 

(Data  Availability)  which  is  backed  by  substantial  empirical  data  for  the 
range  of  population  to  be  modeled. 

(Data  Reliability)  for  which  the  error  range  of  the  available  data  is  known 
and  minimum. 

(Relevance  to  Situation  Being  Modeled)  which  is  critical  to  and  possesses 
obvious  saliency  to  the  acts  and  behaviors  of  individuals  and  groups 
involved  in  the  situation. 

(Sensitivity)  which  will  vary  as  the  result  of  various  events  within  a  situ¬ 
ation. 

(Objectivity)  which  can  be  measured  in  the  population  under  consideration. 

(Amenability  to  Digital  Simulation)  which  can  be  modeled  without  unwar¬ 
ranted  assumptions  and  which  will  not  require  excessive  processing 
time  or  memory  requirements. 

(Uniqueness)  which  is  associated  with  unique  output  variance  (each  vari¬ 
able  should  contribute  to  the  richness  and  completeness  of  the  total 
model). 

(Freedom  from  Need  for  Artifical  Transformation)  for  which  the  ava.  able 
data  do  not  require  excessive  transformation,  rescaling,  preproc¬ 
essing,  or  translation  for  digital  modeling. 

(Generality)  which  is  applicable  to  a  range  of  modeled  situations. 

(Comprehensibility)  which  is  easily  understood  by  the  users  of  the  model's 
output. 

(Utility)  which  is  most  useful  for  answering  the  questions  the  planner  and 
model's  user  wishes  to  ask. 

(Event  Oriented)  which  can  be  updated  at  the  conclusion  of  each  simulated 
event,  and  event  indexed. 
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Table  2-2  (cont.  ) 


(Susceptibility  to  Parametric  Variation)  which  can  be  systematically  varied 
over  a  range  of  levels  or  along  a  continuous  scale. 

(Freedom  from  Triviality)  which  will  produce  pronounced  effects  on  input. 

(Validity)  for  which  the  effects  on  performance  (model  output)  and  on  other 
output  and  intervening  variables  are  known,  agreed  on  by  most  per¬ 
sons,  and  representative  of  the  actual  situation  being  modeled. 

(Heuristic  Value)  which  raises  questions  relative  to  the  system  being  sim¬ 
ulated  as  well  as  answer  questions,  provide  explanations,  analyze 
problems,  provide  solutions,  and  develop  rules. 


(Quantifiability)  can  be  quantified,  measured,  and  scaled. 
(Supportability)  is  supported  by  a  second  body  of  literature. 
(Realism)  is  apparent  in  the  real  life  situation  being  modeled. 


0 


of  6  nodes 
a...f 


FIGURE 


Legend 

s  DECISION  ALTERNATIVE  OR  SOLUTION  STATE 

* - **  s  VALID  DIRECTION ($)  OF  DECISION  MOVEMENT 

•  =  NODE 


-1. 


PARTIAL  REPRESENTATION  OF  A  FIVE-SOLUTION 
PROBLEM  REPRESENTATION. 


S I X-NODE 


A  top  level  flow  chart  of  the  simulation  process  is  presented  in 
Figure  2-2.  After  selecting  the  most  proficient  operator  on  the  basis  of 
his  speed  and  proficiency,  the  step  probabilities  are  first  adjusted  for  op¬ 
erator  ability  and  utility.  Next  (following  resets),  the  decision  implement 
step  is  taken.  If  a  decision  state  is  reached,  the  correctness  of  the  deci¬ 
sion  is  determined  and  the  simulation  proceeds  to  the  decision  time  cal¬ 
culation  sequence  (boxes  9  through  12).  If  no  decision  state  is  entered,  the 
input  probability  matrix  is  altered  by  a  Bayesian  process  and  a  probability 
ratio,  required  in  the  later  complexity  calculation,  is  obtained.  Then,  per¬ 
formance  of  the  next  step  is  simulated,  and  the  decision-no-decision  check  is 
again  made.  This  process  continues  until  a  decision  state  is  entered,  or 
until  the  number  of  steps  has  reached  the  prespecified  limit. 

The  operator  ability  adjustment  causes  an  increase  (higher  profi¬ 
ciency  operator)  or  decrease  (lower  proficiency  operator)  in  the  probabil¬ 
ity  of  a  correct  choice  and  in  the  time  to  reach  a  solution.  The  utility  func¬ 
tion  is  included  because  the  best  solution  is  not  necessarily  the  solution 
with  the  highest  probability.  Utility  is  calculated  on  the  basis  of:  (1)  the 
importance  of  the  decision  on  up  to  any  three  preselected  mission  goals, 
and  (2)  the  effects  of  each  course  of  action  on  the  goals.  The  resultant 
utility  values  are  used  to  adjust  the  input  probability  of  moving  toward 
each  goal. 

Monte  Carlo  processes  are  employed  to  complete  the  stepping  proc¬ 
ess  and  the  final  decision  is  compared  with  the  correct  decision  to  deter¬ 
mine  decision  correctness.  If  the  completion  of  a  step  does  not  cause  the 
simulated  decision  maker  to  enter  a  decision  state,  at  the  conclusion  of  the 
step  the  input  probabilities  are  further  altered  on  the  bases  of  the  Bayesian 
logic.  This  represents  changes  in  the  simulated  decision  maker's  state  on 
the  basis  of  the  information  gained  during  the  step. 

To  calculate  decision  time,  three  variables  are  considered  stochas¬ 
tically:  (1)  the  stress  on  the  simulated  operator,  (2)  the  number  of  steps  to 
reach  a  solution,  and  (3)  problem  complexity. 

Level  of  Aspiration  Simulation- -Motivational  Example 

The  decision  module,  described  above,  represents  a  simulation  of 
a  cognitive  behavioral  variable.  The  level  of  aspiration  simulation  describ¬ 
ed  in  this  section,  on  the  other  hand,  represents  an  example  of  the  simula¬ 
tion  of  a  motivational  variable.  The  NETMAN  model,  a  communication  net¬ 
work  simulation,  of  the  Army  Research  Institute  for  the  Behavioral  and  So¬ 
cial  Sciences  contains  this  subroutine. 


FIGURE  2-2.  OVERALL  FLOW  LOGIC  OF  DECISION  SUBROUTINE. 


As  described  by  Siegel,  Leahy,  and  Wolf  (1977),  the  simulation  is 
based  on  the  thinking  of  Lewin(1942)  and  of  Kelly  and  Thibaut  (1954).  Ac¬ 
cordingly,  as  for  the  decision  simulation,  the  level  of  aspiration  simula¬ 
tion  is  drawn  from  and  based  on  behavioral  theory. 

The  NETMAN  model  is  an  event  sequenced  simulator  which  concen¬ 
trates  on  the  message  handling  aspects  of  Army  field  exercise  manage¬ 
ment  systems.  Aspiration  level  for  each  operator  is  based,  within  the 
model,  on  the  success  level  each  operator  would  hope  to  attain,  where 
success  record  is  defined  as  the  ratio  of  the  number  of  subtask  successes  to 
the  number  of  subtask  attempts.  A  simulated  operator  with  an  aspiration 
value  of  1.00  would  aspire  to  succeed  in  every  one  of  his  task  attempts, 
while  an  operator  with  an  aspiration  value  of  0.  50  would  have  lower  moti¬ 
vation  and  would  be  viewed  as  considering  a  rate  of  one  successful  attempt 
in  two  as  acceptable. 

The  NETMAN  model  is  fully  dynamic  and  the  level  of  aspiration  of 
a  simulated  operator  varies  over  the  course  of  a  simulation  in  accordance 
with  his  success  record.  This  is  accomplished  by  initially  assigning  in¬ 
dividual  aspiration  values,  as  computer  input  parameters,  permitting 
these  values  to  affect  the  speed  of  operator  performance,  and  then  adjust¬ 
ing  the  aspiration  values  as  a  function  of  operator  success  record  and  the 
amount  of  stress  incurred  during  the  simulation. 

Specifically,  the  simulation  considers:  (1)  each  operator's  goal 
discrepancy- -the  difference  between  the  aspired  success  record  and  the 
actual  record,  and  (2)  the  difference  between  current  stress  on  the  operator 
and  a  stress  threshold.  (The  stress  threshold  is  also  a  value  assigned  as 
an  input  parameter. )  Aside  from  the  situation  in  which  there  is  zero  or 
near  zero  goal  discrepancy,  four  discrete  cases  can  exist: 

Case  1  Positive  goal  discrepancy  (i.  e. ,  aspiration 
in  excess  of  actual  performance  recorded 
and  stress  below  the  threshold) 

Case  2  Negative  goal  discrepancy  and  stress  be¬ 
low  the  threshold 

Case  3  Positive  goal  discrepancy  and  stress  equal 
to  or  greater  than  the  threshold 

Case  4  Negative  goal  discrepancy  and  stress  equal 
to  or  greater  than  the  threshold 

Case  1  presents  a  circumstance  which  possesses  positive  motiva¬ 
tional  value--the  operator  is  not  performing  as  well  as  he  would  like  to, 
yet  he  is  only  mildly  stressed,  if  at  all.  The  psychological  expectation  is 


that  he  would  strive  to  perform  better,  and  the  model  effects  this  by  gen¬ 
erating  a  pace  adjustment  factor,  which  causes  the  simulated  operator  to 
work  faster.  Figure  2-3  shows  this  effect. 

Case  2  further  illustrates  the  dynamic  aspect  of  level  of  aspiration, 
both  as  occurring  in  life  and  as  simulated  in  the  model.  A  negative  goal 
discrepancy  exists.  This  means  that  performance  exceeds  operator  aspi¬ 
ration,  and  stress  is  still  of  only  modest  magnitude.  Psychological  theory 
(e.g.,  Deutsch,  1954)  indicates  that  under  these  conditions,  the  operator 
would  "raise  his  sights"  and  aspire  to  do  more,  since  he  demonstrated  to 
himself  that  he  has  easily  attained  the  initial  level.  In  this  regard,  Krech 
and  Crutchfield  (1948)  wrote: 

...  a  successful  individual  typically  sets  his  next  goal 
somewhat,  but  not  too  much,  above  his  last  achieve¬ 
ment.  In  this  way  he  steadily  raises  his  level  of  aspi¬ 
ration.  Although  in  the  long  run  he  is  guided  by  his 
ideal  goal, . . . ,  nevertheless  his  real  goal. .  is  kept 
realistically  close  to  his  present  position. 

This  process  is  simulated  in  the  model  according  to  a  Monte  Carlo  pro¬ 
cedure,  in  which  aspiration  is  increased  and  the  pace  adjustment  factor 
is  set  equal  to  1. 

Case  3  presents  a  circumstance  of  resignation.  The  operator  is 
not  performing  as  well  as  he  would  like,  but  is  incurring  stress  equal  to 
his  threshold.  Because  of  the  stress,  he  has  no  choice  but  to  accept  his 
current  performance  .evel.  The  model  effects  this  by  reducing  the  aspira¬ 
tion  value  so  that  it  equals  the  performar.ee  record.  The  simulated  opera¬ 
tor  has  ceased  his  upward  striving  and  avoids  the  severe  stress  by  accept¬ 
ing  his  current  performance.  However,  associated  with  the  cessation  of 
upward  striving,  with  the  "edge"  off  the  individual’s  motivation,  one  might 
expect  to  observe  the  beginnings  of  a  partly  voluntary  and  partly  involun¬ 
tary  deterioration  in  performance.  This  effect  is  simulated  in  the  model 
by  modifying  the  performance  adjustment  factor  so  as  to  slow  down  the 
rate  at  which  the  operator  performs  his  tasks  (see  Figure  2-3). 

In  Case  4,  current  stress  is  altered.  Specifically,  Case  4  presents 
the  circumstances  of  performance  exceeding  operator  aspiration,  but 
stress  being  substantial.  That  is,  the  operator  is  incurring  severe  stress, 
despite  the  fact  that  he  has  attained  the  level  of  performance  he  set  for  him¬ 
self.  It  seems  reasonable  that,  as  he  reviews  his  success  record,  he  stops 
"sweating  it"  quite  so  desperately  for  he  has  demonstrated  that  he  can  at¬ 
tain  his  aspiration  level.  In  the  model,  this  is  simulated  by  reducing  the 
operator's  current  stress  to  a  value  18  percent  below  the  stress  threshold. 
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FIGURE  2-3 


.  PACE  ADJUSTMENT  FACTOR,  A  FUNCTION  OF  ASPIRATION  AND 
PERFORMANCE,  AS  REPRESENTED  WITHIN  NETMAN  MODEL 


Operator  Characteristic  Simulation --Physical  Capacity  Example 


Another  class  of  variables  included  in  behavioral  models  includes 
the  personal  characteristics  of  the  individual(s)  simulated.  Examples  of 
such  variables  which  have  been  included  in  prior  models  are  operator 
speed,  operator  precision,  and  operator  physical  capacity  (a  strength 
measure). 


The  operator  physical  capacity  simulation  was  selected  to  exemplify 
simulations  in  this  class.  Siegel,  Wolf,  and  Cosentino  (1971)  developed  a 
physical  capability  algorithm  which  is  applied  to  each  person  in  a  work 
group  at  the  start  of  the  simulation  of  the  performance  of  a  subtask  by  the 
group.  They  drew  their  simulation  approach  from  a  literature  analysis  and 
assumed  that  the  physical  capability  of  a  person  decreases  over  time  at  work, 
total  work  completed,  overexertion,  and  disability.  They  also  assumed  that 
physical  capability  varies  among  men.  Siegel,  Wolf,  and  Cosentino  assumed 
the  effects  to  be  independent  of  each  other  and  to  act  independently.  The 
function  for  current  physical  capability  of  crew  member  M,  PCC(M),  was 
expressed  analytically  as: 


PCC(M)=PC(M)  •  PI(M) 


W  «  “t 

•  gf^-)  •  [1  -  0.1  FAT(M>] 


Here,  PC(M)  is  the  physical  capability  (related  to  strength)  of  the  man,  as 
calculated  in  another  subroutine  of  the  model  (1  is  an  average  value).  PI 
(M)  is  the  physical  incapacity  value  related  to  minor  sickn^ses  (also  cal¬ 
culated  in  another  subroutine).  The  factor  [1  -  (1-K1)  (■  .  is  term¬ 

ed  the  work  factor.  Here,  W  is  the  total  work  done  (calories  expended)  on 
all  events  from  the  last  sleep  period  up  to  and  including  half  of  the  calories 
expected  to  be  expended  on  the  present  event.  In  symbolic  representation, 

W  =  ACAL(M),  where  ACAL(M)  is  maintained  by  the  computer  as  the  tally 
of  accumulated  calories  expended.  CAL(M)  is  the  average  number  of  cal¬ 
ories  expended  in  a  normal  working  day  for  each  man.  The  K1  term  rep¬ 
resents  a  disability  factor--a  fraction  to  which  the  work  factor  falls  when 
a  man  has  completed  his  normal  quota  of  work  during  the  day.  According¬ 
ly,  within  the  simulation,  a  man's  capability  decreases  as  he  continues  to  work 
and  is  reduced  to  the  value  K1  after  a  normal  day's  effort.  The  term  g(P-p/Pj^ 
represents  an  overexertion  effect.  Here,  a  mismatch  of  capabilities  between 
the  men  assigned  and  the  physical  requirements  of  the  events,  in  terms  of 
energy  (calories)  required,  are  considered.  The  function  is: 


1 

c  "  pt/pn 

c  -  1 


when  Pt/pN  —  * 
when  I^Pt/Pn^c 


4 


29 


Thus,  the  overexertion  factor  has  no  influence  as  long  as  the  work  rate 
for  the  given  event  does  not  exceed  the  peak  work  rate  expected  for  the 
men.  Here,  P-p  =  work  rate  for  the  event,  P]\j  =  peak  work  rate,  and  c  = 
value  of  Pj/Pn  yielding  zero  physical  capability  due  to  overexertion. 
The  function  is  represented  graphically  as  shown  in  Figure  2-4. 


Figure  2-4.  Overexertion  function. 


The  last  term  of  the  PCC(M)  equation  is  a  function  of  the  fatigue  of 
the  person(s)  simulated  - -i.  e. ,  the  time  elapsed  and  sleep  duration. 


Visual  Recognition  Simulation- -Perceptual  Example 

The  final  behavioral  simulation  to  be  described  here  involves  rec¬ 
ognition  of  objects  by  a  person  who  views  a  cathode  ray  tube.  Siegel, 
Wolf,  and  Williams  (1978)  developed  this  module  to  be  embedded  within  a 
total  simulation  of  the  behavior  of  the  system  operator.  The  problem  was 
to  simulate  the  ability  of  an  operator  to  correctly  recognize  (classify)  an 
object  once  a  discriminable  pattern  appears  on  the  cathode  ray  tube. 

Siegel  et  al.  based  the  simulation  on  the  "encoding  specificity  prin 
ciple"  Tulving  and  Thomson  (1973).  According  to  Tulving  and  Thomson, 
specific  encoding  operations  are  performed  on  what  is  perceived  to  deter¬ 
mine  what  is  stored,  and  what  is  stored  determines  what  retrieval  cues 
are  effective  in  providing  access  to  what  is  stored.  The  relative  strength 
of  cues  as  features  constituting  the  perceptual  context  at  the  time  of  learn 
ing  is  thereby  emphasized. 
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This  thinking  was  mirrored  by  Reed  (1973)  who  indicated  the  rel¬ 
ative  ascendancy  of  "features  analysis"  over  "template  matching"  because 
features  analysis  rests  on  structuring  the  stimulus  pattern  in  terms  of 
primitive -characterized  strokes  to  correspond  to  environmental  invariants. 

The  recognition  simulation  of  Siegel,  Wolf,  and  Williams  first  calls 
for  determining  an  initial  classification  probability  on  the  basis  of  the 
number  of  strokes  in  the  generated  target.  This  first  approximation  is 
based  on  the  logic  of  Deese  (Zusne,  1970)  that  "stimulus  complexity  and 
ease  of  identification  appear  to  be  related  as  a  U-shaped  function.  "  That 
is  to  say,  features  can  neither  be  too  few  or  too  many  and  neither  too 
similar  nor  too  dissimilar  to  expedite  the  recognition  of  pictorial  images. 
The  function  employed  in  the  simulation  (Figure  2-5)  was  developed  on 
the  basis  of  the  data  presented  by  Levine  and  Eldredge  (1974)  who  asked 
experienced  photointerpreters  to  classify  a  set  of  already  detected  targets. 

This  initial  classification  probability  is  then  successively  moder¬ 
ated  (degraded)  by  four  functions:  (1)  deviation  from  primitive  in  number 
of  strokes,  (2)  deviation  from  primitive  in  angle  of  main  stroke,  (3)  de¬ 
viation  from  primitive  in  length  of  main  stroke,  and  (4)  deviation  from 
primitive  in  curvature  of  main  curved  line,  if  any. 

The  first  of  these  functions,  deviation  from  the  primitive  in  terms 
of  number  of  strokes  (Figure  2-6),  is  based  on  the  conjecture  that  classi¬ 
fication  accuracy  will  degrade  as  the  detail  in  a  representation  deviates 
from  learned  or  anticipated  detail.  In  a  sense,  a  figure  which  is  the  same 
as  a  learned  figure  can  be  considered  to  be  a  structured  stimulus.  The 
influence  of  structure  in  form  perception  was  acknowledged  by  Aiken  and 
Brown,  (1971)  who  asserted  that  "Thus  it  appears  that  the  O,  in  dealing 
with  relatively  weakly  structured  stimulus  configurations,  will  impose  a 
consistent  structure  of  his  own  generation,  to  organize  the  stimulus  con¬ 
figuration"  (p.  282).  Arnoult  (1960)  concluded  similarly.  Empirical  im¬ 
age  evaluative  studies  (Coluccio  &  Wasielewski,  1970;  MacLeod,  1964)  in 
which  the  amount  of  structure  (learned  detail)  was  varied  also  support 
this  conjecture. 

The  deviation  from  angle  of  main  stroke  function  rests  on  the  argu¬ 
ment  that  a  shape  rotated  out  of  the  orientation  in  which  it  was  learned  is 
less  readily  recognized.  As  stated  by  Hake, 

Actually,  the  fact  that  recognition  of  forms  and 
comparative  judgments  of  forms  deteriorates 
when  forms  are  rotated  with  respect  to  the  ob¬ 
server  has  been  known  for  a  long  time  (1966, 
p.  151). 


STOCHASTIC 
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NUMBER  OF  STROKES 

FIGURE  2-5.  INITIAL  CLASSIFICATION  PROBABILITY  AS  A  FUNCTION 
OF  THE  NUMBER  OF  STROKES  IN  GENERATED  TARGET. 
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DEVIATION  FROM  PRIMITIVE -NUMBER  OF  STROKES  (DPNS) 


FIGURE  2-6.  DEGRADATION  OF  CLASSIFICATION  PROBABILITY 
AS  A  FUNCTION  OF  DEVIATION  IN  NUMBER  OF  STROKES- 


Hake  reported  a  number  of  studies  which  support  the  contention  of  modi¬ 
fied  association  value  for  slanted  (rotated)  figures. 

In  the  simulation,  the  results  of  Arnoult  (1960)  were  relied  on  to 
provide  the  basic  function.  Arnoult  varied  10  nonsense  shapes  over  eight 
angular  positions  and  asked  subjects  for  same  or  different  judgments  when 
the  rotated  shape  was  compared  toastandard.  Arnouit's  data  were  smoothed 
and  rescaled.  However,  the  shape  of  the  Arnoult  curve  was  closely  approx¬ 
imated.  The  resultant  function  is  shown  in  Figure  2-7. 

The  function,  deviation  from  length  of  main  stroke  (Figure  2-8), 
presupposes  that  subjective  response  alternatives  increase  as  the  target 
size  decreases  so  that  the  match  between  current  stimulus  and  its  mental 
template  in  memory  is  more  difficult.  That  is,  guessing  must  be  instituted 
until  a  correct  "match"  between  current  stimulus -input  and  memory-pattern 
has  been  achieved  when  very  small  targets  are  involved.  The  constraints 
that  preexist  in  the  real  environment  need  to  be  discovered  through  succes¬ 
sive  trial-and -error  episodes,  until  stimulus  features  correspond  to  prede¬ 
fined  pattern  features  sufficiently  that  the  intended  recognition  response  is 
obtained. 

Bruns,  Bittner,  and  Stevenson  (1972)  in  a  dynamic  television  identi¬ 
fication  task  concluded  that  "Target  effects  were  primarily  related  to 
target  size  expressed  either  as  target  area  or  target  diagonal.  "  The  data 
of  Bruns,  Bittner,  and  Stevenson  were  employed  to  derive  the  required 
function  (Figure  2-8).  Their  data  indicated  an  almost  linear  relationship 
(r  =  .  98)  between  slant  range  identification  and  target  diagonal  with  a  slant 
range  identification  ratio  of  about  6;1  for  "small"  as  compared  with  "larger" 
targets. 

The  fourth  function  (Figure  2-9),  deviation  in  curvature,  was  sim¬ 
ilarly  based  on  the  contention  that  deviation  from  an  anticipated  image  will 
decrease  classification  accuracy. 

Unfortunately,  no  studies  were  identified  by  the  developers  of  the 
simulation  which  reported  data  relative  to  the  effect  of  curvature  on  rec¬ 
ognition  accuracy.  Accordingly,  the  Figure  2-9  curve  was  derived  on 
the  basis  of  the  best  professional  judgment  of  the  developers  of  the  sim¬ 
ulation. 

The  recognition  module  also  considers  context,  operator  proficiency, 
and  stress.  The  context  effect  was  based  on  the  work  of  Miller,  Heise,  and 
Lichten  (1951)  who  reported  a  range  of  context  effects  of  about  30  percent. 

To  simulate  this  effect,  a  random  number  equiprobable  in  the  range  0  to  .  30 
is  drawn  and  applied.  Operator  proficiency  and  the  stress  effect  are  sim¬ 
ulated  in  much  the  same  manner  as  for  other  models  developed  by  Siegel 
and  his  coworkers. 
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FIGURE  2-7.  DEGRADATION  OF  CLASSIFICATION  PROBABILITY  AS  A  FUNCTION 
OF  DEVIATION  FROM  ANGLE  OF  MAIN  STROKE. 
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DEVIATION  FROM  PRIM  ITIVE  (IN  CATEGORIES)  IN  LENGTH  OF 
PRIMARY  STROKE 

FIGURE  2-8.  DEGRADATION  OF  CLASSIFICATION  PROBABILITY  AS  A  FUNCTION  OF  DEVIATION 

FROM  LENGTH  OF  MAIN  STROKE. 


DEVIATION  FROM  PRIMITIVE  (IN  CATEGORIES)  IN  CURVATURE 


FIGURE  2-9. DEGRADATION  OF  CLASSIFICATION  PROBABILITY  AS  A  FUNCTION  OF  DEVIATION 

IN  CURVATURE  OF  MAIN  CURVED  LINES. 


The  logic  flow  for  the  total  recognition  subroutine  is  presented 
as  Figure  2-10. 

Discussion  of  Simulations  Described  Above 

Each  of  the  above  described  simulator  modules,  as  for  most  be- 
haviorally  oriented  simulations,  is  based  on  current  behavioral  theory. 
They  all  attempt  to  quantify  that  theory  and  set  it  in  a  form  suitable  for 
computer  implementation.  Four  relatively  discrete  modules  were  se¬ 
lected  so  as  to  provide  some  insight  into  the  scope  of  some  of  the  simu¬ 
lations  that  have  already  been  developed  and  of  the  dynamic  character  of 
such  simulations. 

Such  modules,  when  embedded  within  a  total  behavioral  or  person- 
machine  system  simulation,  provide  a  rather  sophisticated  method  for 
system  evaluation.  The  decision  module  and  the  recognition  module  form¬ 
ed  part  of  a  total  simulation  developed  for  the  Air  Force  (Siegel,  Wolf,  &. 
Williams,  1978).  This  total  model  sought  to  simulate  the  behavior  of  the 
image  interpretion  operator  of  an  advanced  electronic  imagery  system. 

The  motivation  module  formed  a  part  of  the  Army  simulation  of  exercise 
control  systems  called  NETMAN  (Siegel,  Leahy,  &  Wolf,  1977).  The  op¬ 
erator  physical  capability  simulation  formed  a  part  of  a  Navy  simulation 
of  the  performance  of  crews  of  intermediate  size  (4-20  men)  stations  (Siegel, 
Wolf,  &  Cosentino,  1971).  Accordingly,  the  contention  may  be  advanced 
that  such  modeling  has  been  found  useful  by  each  of  the  services  in  a  var¬ 
iety  of  contexts. 

Quite  obviously,  such  modeling  would  find  itself  of  interest  in  a 
variety  of  additional  Army  simulations.  Offensive,  defensive,  and  tactical 
battle  models  depend  on  the  ability  of  the  soldier  to  perform  mental/ phys¬ 
ical  operations  such  as  those  encompassed  by  the  simulations  described 
above.  For  example,  mechanized  infantry,  tank  crews,  and  FIST  must 
recognize  and  classify  targets.  Decision  making  is  inherent  in  the  jobs 
of  every  soldier  at  every  level.  The  effects  of  stress  on  performance  be¬ 
come  particularly  relevant  when  one  considers  the  anticipated  character 
of  future  warfare. 

Table  2-3  identifies  25  different  current  military  models  which 
possess  human  resources  implications  and  the  types  of  behavioral  sub¬ 
routines  which,  if  included  in  these  models,  would  lend  increased  verid- 
icality  to  them. 
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CALCULATE  INITIAL  CLASSIFICATION  PftOB-  CALCULATE  DEGRADATION  OF  CALCULATE  DEGRADATION  OF 

ABILITY  AS  A  FUNCTION  OF  THE  NUMBER  OF  INITIAL  CLASSIFICATION  PROB-  INITIAL  CLASSIFICATION  PROB- 

STROKES  (SEE  FIGURE  5)  ABILITY  ASA  FUNCTION  OF  DEVIA-  ABILITY  AS  A  FUNCTION  OF  DEVI  A 

TION  IN  NUMBER  OF  STROKES  TION  IN  CODES  FOR  LENGTH  OF 

ICP®  K1  (STROKES)  +  (T1)  (RYJ  <1.0  - »  {SEE  FIGURE  8)  - »  MAIN  STROKE  (SEE  FIGURE  7) 


FIGURE  2-10.  FLOW  LOGIC  FOR  VISUAL  RECOGNITION  MODULE. (CONT’D) 


FIGURE  2-10.  FLOW  LOGIC  FOR  VISUAL  RECOGNITION  MODULE. (CONT'D) 
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ILL  PROBLEMS  IN  MODEL  DESIGN 


Selection  of  Type  of  Model 


The  first  question  with  which  the  model  developer  needs  to  con¬ 
cern  himself  involves  the  type  of  model  he  requires.  This  question  is 
basic  and  subsequent  model  design  decisions  will  depend  on  the  answer. 
First,  consider  that  behavioral  simulation  models  may  be  conceived  as 
falling  into  one  of  four  classes: 

Performance 


Functional 


Psycho¬ 

logical 


Driver 


Tasks 


Events 


Models  may  be  driven  on  the  basis  of  events  (tasks)  or  on  the  basis 
of  unit  time  increments.  Performance  may  be  functionally  represented  or 
it  may  be  constrained  on  the  basis  of  psychological  (human  oriented)  con¬ 
structs. 

Drivers 


Task  or  event  driven  simulations  sequentially  simulate  the  per¬ 
formance  of  the  subtasks  of  a  given  task  or  the  events  to  be  performed 
during  a  specified  duty  segment.  They  are  most  applicable  when  the  sub¬ 
task  or  event  sequence  is  to  some  extent  known  and  fixed.  The  Siegel  - 
Wolf  (1969)  model  is  an  example  of  an  event  driven  model.  In  such  a  model, 
time  may  be  accumulated  on  the  basis  of  the  time  for  event  performance 
but  the  event  performance  drives  the  time  and  not  the  reverse. 

Event  driven  models  may  be  further  subcategorized  as  "event  or¬ 
iented"  or  "activity  oriented.  "  In  the  event  oriented  advance,  single  events 
trigger  partial  state-change  routines.  In  activity  advance,  a  complete 
series  of  state  changes  is  triggered  at  the  time  all  conditions  are  satisfied 
to  permit  an  activity  to  start  or  stop. 


Time  driven  simulations  are  based  on  the  passage  of  time.  They 
advance  on  the  basis  of  some  internal  clock.  When  a  given  time  is  reach¬ 
ed,  the  system  state  is  simulated  and  the  results  are  recorded.  There 
need  be  no  event  list  or  associated  processing. 

The  time  advance  approach  is  less  preferable  if  there  are  many 
periods  when  no  events  occur.  Event  advance  procedures  will  generally 
be  preferable  when  the  added  calculations  for  the  event  list  do  not  exceed 
the  overhead  involved  in  time  advance  (uneventful  periods).  If  events  oc¬ 
cur  on  a  fairly  regular  basis,  time  advance  periods  can  be  established  in 
a  way  that  minimizes  the  chance  of  advancing  to  periods  of  inactivity — in 
which  cases  time  advance  is  to  be  preferred. 


Performance 

Functional  models  simulate  performance  directly.  They  do  not 
concern  themselves  with  higher  order  constructs  or  intervening  variables. 
Most  engineering  models  would  probably  fall  into  this  category.  A  person¬ 
nel  utilization  model  (Feiler,  1971)  typifies  this  type  of  model.  The  general 
scheme  for  Feiler 1  s  model  is  shown  in  Figure  3-1.  In  this  model,  the  head 
nurse  reports  to  work  and  "proceeds"  directly  to  her  routine  tasks.  From 
time-to-time,  she  is  interrupted  by  nonroutine  tasks  such  as  responding 
to  phone  calls  and  patient  incidents.  Note  that  activities  are  simulated  as 
events  without  the  superimposition  of  higher  order  constructs  and  that  the 
model  is  event  driven. 

Psychological  models  rely  on  constructs  such  as  stress,  aspiration, 
etc.  as  the  basis  for  the  simulation.  These  constructs  are  considered 
interactively  and  in  a  sophisticated  manner.  The  four  simulations  de¬ 
scribed  in  Chapter  II  under  the  heading  of  "Specific  Behavioral  Traits 
Modeled  and  Their  Logic"  represent  examples  of  this  type  of  simulation. 

Quite  obviously,  there  may  be  mixed  models  with  different  sub¬ 
routines  representing  different  classes  of  simulation.  The  functional- 
task  driven  category  probably  represents  the  easiest  (quickest)  type  of 
model  to  develop.  However,  functional -task  models  may  lack  richness. 
They  will  answer  the  "Does  it  work?  "  question  but  may  provide  barren 
answers  to  the  "Why  does  it  work?  "  or  "How  to  make  it  work  better?  " 
questions. 

The  functional-time  driven  category  is  next  on  the  hierarchy  of  con¬ 
struction  difficulty.  Models  in  this  class  provide  no  more  insight  than 
event  driven  models. 

Psychological  models  are  more  difficult  to  develop  but  are  believed 
to  represent  a  necessary  ingredient  in  any  model  which  purports  to  simu¬ 
late  a  system  in  which  human  attributes  exert  salient  effects.  Models 
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FIGURE  3-1.  HEAD  NURSE  SIMULATION  MODEL  (U.C.L.A.  HOSPITAL)  OF 
FEILER  (1971). 


of  person-equipment  systems  which  fail  to  consider  human  behavioral 
effects  cannot  be  held  to  represent  fully  the  system  being  modeled. 

Both  event  driven  and  time  driven  psychological  models  provide 
insight  into  a  wide  variety  of  questions  relative  to  system  trade  offs  and 
optimization.  However,  models  in  these  classes  are  the  most  difficult 
and  time  consuming  to  construct 

Data  Requirements  and  Data  Availabilit 


The  ultimate  success  of  a  behavioral  simulation  model,  like  any 
computer  simulation  model,  depends  on  the  validity  of  the  input  data  uti¬ 
lized.  A  model  may  be  fully  acceptable  in  terms  of  its  constructs  but  may 
be  unusable  because  the  input  data  required  for  implementing  the  constructs 
are  not  available  or  are  not  at  a  required  level  of  accuracy.  This  applies 
both  to  the  numerical  constants  utilized  as  part  of  the  model  program  as 
well  as  to  the  parameter,  mission,  and  operator  data  provided  as  input  to 
each  model  run. 

While  a  number  of  data  banks  (e.  g. ,  Munger  &  Smith,  1962)  are 
available,  such  data  banks  are  remarkably  barren  in  regard  to  higher  or¬ 
der  human  processes  and  abilities.  Moreover,  in  view  of  individual  dif¬ 
ferences,  normative  data  based  on  general  populations  are  often  of  little 
use  to  a  behavioral  simulation.  This  input  data  relevancy  consideration 
is  part ic xila rly  pertinent  to  simulations  of  Army  personnel.  Quite  obvi¬ 
ously,  there  is  little  sense  in  developing  a  sophisticated  simulation  only  to 
find  later  that  the  required  input  data  are  either  meager  or  lacking.  Too 
often  the  model  designer  approaches  his  model  development/ opportunities 
with  little  concern  over  the  availability  of  input  data.  Such  concerns  are 
considered  by  the  model  developer  to  be  mundane  and  are  left  for  the  model 
user.  But,  the  model  user  wants  model  output  results  and  often  has  little 
time,  patience,  or  ability  to  develop  or  obtain  esoteric,  behaviorally  ori¬ 
ented  data. 

Level  of  Data  Detail 


Assuming  the  availability  of  the  required  input  data,  how  much 
burden  does  the  model's  requirements  place  on  the  user?  Some  models 
require  long  lists  of  appropriately  coded  input  information.  The  input 
chore  can  be  further  magnified  by  a  programmer  who,  with  commendable 
computer  system  expertise  but  little  human  factors  insight,  may  require 
features  such  as  right  justification  of  input  or  esoteric  and  fixed  card  for¬ 
matting.  Other  model  designers,  are  more  considerate  and  their  models 
are  more  tolerant.  Input  data  are  stored  and  only  modifications  to  pre¬ 
stored  values  are  required  of  the  user;  free  format  entry  is  permitted  and 
the  amount  of  required  input  data  is  limited. 
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There  is  obviously  some  upper  limit  on  the  amount  of  time  that 
the  user  -wishes  to  spend  on  preparing  input  data.  To  promote  use  and 
practicality,  initial  data  preparation  must  be  reasonable  for  initial  pre¬ 
paration,  reruns,  and  changes  of  missions  and  parameters.  Use  of  in¬ 
teractive  terminals  on  a  conversational  basis  promotes  this  end. 


Programming 


Programming  a  behavioral  simulation  represents  the  translation 
of  the  model's  logic  to  a  form  that  is  usable  by  a  specific  digital  computer. 
In  some  cases,  the  person  who  develops  the  model's  logic  also  performs 
the  translation.  In  other  cases,  an  independent  computer  programmer 
may  be  used.  Provided  that  a  fully  detailed  set  of  program  specifications 
or  detailed  flow  chart  has  been  developed,  there  seems  to  be  little  advan¬ 
tage  of  one  procedure  over  the  other.  Table  3-1  presents  the  advantages 
of  each  type  of  assignment  to  the  programming.  Of  course,  if  the  person 
who  developed  the  logic  has  little  or  no  programming  ability,  there  is  no 
choice  other  than  the  assignment  of  a  professional  programmer  to  the 
work. 

Table  3-1 


Comparison  of  Advantages  of  Assigning  Model  Developer 
_ or  Programmer  to  Model  Programming  _ _ 


Advantages  of  Assigning 
Model  Developer 

1.  Fewer  errors  in  repre¬ 
sentation  (flow  chart 
misinterpretation) 


Advantages  of  Assigning 
Professional  Programmer 

1.  More  efficient  final  pro¬ 
gram  and  system  use 

2.  Time  savings 


2.  Logic  changes  needed  to 
facilitate  programming  can 
be  made  "on-the-spot” 

3.  Avoids  developer-program¬ 
mer  communication  difficul¬ 
ties 

4.  Results  in  better  user  input 
formats 


3.  Less  costly 

4.  Does  not  divert  needed 
"modelist"  talent  to  a 
task  which  can  be  done  by 
others 

5.  Probably  results  in  fewer 
program  "bugs" 


Regardless  of  the  approach  adopted,  errors  do  occur  in  virtually 
all  programming.  We  are  not  concerned  as  much  with  coding  errors  which 
will  be  uncovered  by  normal  check  procedures  as  with  logic  misrepresenta¬ 
tion  and/or  misinterpretations.  These  are  sometimes  difficult  to  check 
and  will  occasionally  remain  undetected  even  after  anextensive  program  check. 
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When  these  become  evident  during  model  application,  considerable  confu¬ 
sion  can  result.  Air  Force  studies  have  shown  that  corrections  of  program 
design  errors  cost  only  about  10  percent  as  much  to  make  during  the  de¬ 
sign  phase  as  those  not  detected  until  the  program  is  in  a  maintenance  stage. 
The  model  user  may  be  unfamiliar  with  both  the  logic  and  the  programming 
details.  Accordingly,  the  user  will  find  it  difficult  to  implement  the  requir¬ 
ed  adjustments.  The  result  may  be  that  he  will  be  forced  to  abandon  his 
anticipated  use  of  the  model. 

A  word  on  trends  in  the  computer  language  currently  selected  for 
models  is  in  order.  The  DoD  Catalog  of  Logistics  Models  (Air  Force  In¬ 
stitute  of  Technology,  1980)  reported  the  programming  language  for  174 
models.  By  far,  the  largest  single  language  used  was  FORTRAN  in  its 
various  forms  (used  in  134  of  the  174  entries).  Other  general  purpose 
languages,  i.  e. ,  standard  compilers,  were  popularly  used  asfollows: 

COBOL  11 
BASIC  5 

PL-1  5 

PASCAL  1 

Total  22 

Of  considerable  interest,  and  somewhat  surprising,  is  the  fact  that  rela¬ 
tively  few  models  utilized  the  special  programming  languages  specifically 
developed  to  facilitate  simulation  programming  efforts: 

SIMSCRIPT  8 

DYNAMO  5  .  .  .  4  .  , 

£,pgg  2  problem  oriented  languages 

GASP  1 

SPSS  1 

Total  18 

These  data  represent  the  selection  of  FORTRAN  in  about  77  percent 
of  logistics  models,  other  standard  languages  in  about  13  percent,  and  use 
of  a  "simulation"  language  in  about  10  percent  of  the  cases.  A  description 
of  the  various  simulation  languages,  together  with  an  analysis  of  the  pro¬ 
cess  of  reasoning  an  analyst  might  use  in  language  selection  is  given  in 
Emshoff  and  Sisson  (1970).  The  significant  efforts  in  simulation  language 
developments  in  the  1960s  have  had  comparatively  little  real  impact  on  the 
model  development  community. 


Trans  portability 


Transportability  refers  to  the  capability  to  transfer  a  completed 
and  tested  model  to  users  other  than  the  original  developer(s).  If  the  mod¬ 
el  user  and  model  developer  are  one  and  the  same  person,  then  transport¬ 
ability  is,  of  course,  not  a  problem.  However,  if  the  model  is  to  be  em¬ 
ployed  by  users  other  than  the  original  developer,  the  problem  of  proper  sup¬ 
port  to  the  user(s)  must  be  handled  as  it  would  be  with  any  software  package.  The 
way  to  avoid  such  problems  is  to  anticipate  them  at  the  outset  and  to  provide 
the  tools  that  facilitate  a  multiuser  situation.  Some  ground  rules  for  avoid¬ 
ing  transfer  problems  are: 

•  Program  in  a  high-order  language  which  is  generally 
known  (e.  g. ,  FORTRAN  IV,  BASIC);  avoid  machine 
and  assembly  languages 

©  Fully  comment  the  program 

•  Structure  the  program 

•  Program  for  a  computer  system  which  is  readily 
available  and  possesses  adequate  peripherals,  ter¬ 
minals,  and  storage  capacity 

•  Provide  for  planned  program  maintenance,  i.  e. , 
offer  a  service  to  correct  errors 

•  Make  arrangements  for  providing  each  release  of 
the  program  in  machine  readable  form  to  all  users; 
unless  the  number  of  users  is  small,  do  not  plan 
on  special  modification  of  the  model  to  meet  the 
needs  of  some  specific  users 

•  Date  released  material  and  assign  a  release  num¬ 
ber  to  it 

©  Provide  a  fully  detailed  logic  description  of  the 
model 


©  Provide  a  fully  detailed  users'  manual  including, 
but  not  limited  to,  program  overview  description, 
limits,  variable  list,  program  list,  operating 
instructions,  examples  of  input  formats  and  output 
results,  program  control  instructions,  and  glossary 

©  Try  to  avoid  calling  from  system  libraries  subrou¬ 
tines  which  are  not  generally  available  in  most  com¬ 
puter  libraries- 
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•  Prepare  training  materials  and  present  formal  and 
hands-on  training  when  delivering  the  model  to  each 
user;  incremental  training  may  also  be  required  for 
new  releases  and  for  users*  replacement  personnel 

•  Provide  a  mechanism  by  which  users  can  call  or 
write  to  describe  and  obtain  help  on  problems  and 
can  suggest  future  model  enhancements;  this  "home 
office"  support  may  involve  over  the  phone  consulta¬ 
tions  and/or  visits  to  user  facilities 

•  Provide  full  output  interpretation  instructions 

•  Document  user  problems  as  they  occur  so  that  the 
users*  manual  and  associated  materials  may  be 
updated 

•  Pretest  all  model  releases  and  user  materials  on 

a  sample  which  represents  the  total  user  population 
before  distributing  the  materials;  prearranged  test 
sites  (test  users)  are  often  selected  to  facilitate  this 
process. 


Model  Validation 

Model  validation  may  represent  the  most  talked  about  and  least  un¬ 
derstood  aspect  of  model  development.  One  aspect  of  the  problem  may 
rest  in  the  confusion  brought  about  by  the  application  of  test  validation  con¬ 
structs  to  model  validation.  Quite  fortunately,  models  are  not  psychomet¬ 
ric  tests  and  the  test  development  paradigm  may  not  be  applicable.  We 
argued  earlier  that  the  principal  test  of  any  behavioral  model  is  its  prac¬ 
tical  utility.  This  is  not  to  say  that  some  type  of  validation  is  not  necessary. 
The  decision  maker  cannot  arrive  at  a  proper  decision  on  the  basis  of  in¬ 
valid  data. 

Relative  to  the  validation  problem,  Milton  Friedman  set  the  stage 
in  1953  when  he  argued  that  modelists  have  missed  the  point  by  focusing  on 
the  internal  constructs  of  a  model.  Friedman  contended  that  the  validity  of 
a  model  rests  not  on  its  assumptions  and  constructs,  but  on  its  ability  to 
predict  dependent  variables.  Relative  to  construct  validation,  Friedman 
wrote: 


. . .  This  widely  held  view  is  fundamentally  wrong 
and  productive  of  much  mischief.  Far  from  pro¬ 
viding  an  easier  means  for  sifting  valid  from 
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invalid  hypotheses,  it  only  confuses  the  issue, 
promotes  misunderstanding  about  the  significance 
of  empirical  evidence  for  economic  theory,  pro¬ 
duces  a  misdirection  of  much  intellectual  effort 
devoted  to  the  development  of  consensus  on  tenta¬ 
tive  hypotheses. ..  [1953,  p.  14], 

Hatch  (1971)  reviewed  the  confusion  among  modelists  about  the 
validation  problem.  In  a  discussion  of  "How  do  you  know  it  is  valid?  " 

Hatch  concluded  that  "Ultimately,  this  becomes  a  question  of  the  cred¬ 
ibility  of  the  model.  "  Morganthaler  (1961)  stated  that  "Simulation  is  still 
evolving,  and  the  basic  question  of  validity  of  results  must  be  further  re¬ 
solved  theoretically.  "  Naylor,  Balintfy,  Burdick,  and  Chu  (1966)  maintain¬ 
ed  that  ", .  .the  problem  of  verifying  simulation  models  remains  today  per¬ 
haps  the  most  elusive  of  all  the  unresolved  problems  associated  with  com¬ 
puter  simulation  techniques"  and  Sission  (1969)  concluded,  "Thus,  with  a 
new  simulation  model  about  all  that  can  he  hoped  for  is  a  test  of  reason¬ 
ableness  and  an  act  of  faith.  "  These  types  of  thinking  may  be  the  reason 
that  not  one  of  the  models  in  the  DoD  Catalog  of  Logistics  Models  (Air 
Force  Institute  of  Technology,  1980)  is  reported  to  be  validated. 

Mayberry  (1971)  defined  a  valid  model  as  one  in  which  there  is  an 
earnest  search  for,  and  failure  to  find,  a  disqualifying  defect.  Mayberry 
listed  six  disqualifying  defects: 

(1)  Symmetry — If  two  entities  play  the  same  role  in 
the  r.eal  world,  they  should  play  the  same  role 
in  the  model 

(2)  Continuity— If  the  real  world  is  continuous,  the 
model's  output  should  be  continuous 

(3)  Indifference  to  trivial  aggregation — If  two  model 
parts  are  integrated,  the  output  should  be  the 
same  as  for  the  separate  representations 

(4)  Correct  behavior  in  the  limit--If  the  model's 
output  at  its  limits  is  not  credible,  the  inter¬ 
mediate  points  may  also  be  suspect 

(5)  Correct  direction  of  change--If  a  change  in  a  real 
world  independent  variable  causes  a  change  in  a 
real  world  dependent  variable  an  acceptable  model 
should  reflect  this  change 

(6)  Physical  dimension- -If  results  changes  are  strictly 
dependent  in  the  units  of  measurement  employed, 
the  model  is  suspect. 
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Hatch  (1971)  suggested  a  number  of  steps  to  be  implemented 
during  the  model  development  to  assure  model  validity.  These  includ¬ 
ed:  (1)  adequacy  of  concepts,  (2)  assurance  that  model  agrees  with  de¬ 
sign  specifications,  (3)  test  of  model's  assumptions,  (4)  verification  of 
the  model's  results  against  predetermined  results,  and  (5)  comparison 
between  model  output  and  a  real  world  process. 

With  the  above  backdrop  in  mind,  we  contend  that  model  validation 
is  feasible  and  that  the  Campbell  and  Fiske  (1959)  procedures  for  assessing 
convergent  and  discriminant  validity  through  a  multitrait-multimethod 
analysis  represents  the  most  appropriate  method  for  validation  of  comput¬ 
er  simulation  models.  When  the  traditional  approaches  to  validation  (i.  e. , 
content,  construct,  concurrent,  predictive  validity)  which  are  prescribed 
for  assessing  the  validity  of  tests,  are  applied  as  criteria  for  evaluating 
digital  simulation  models,  two  problems  immediately  became  apparent. 
First,  since  models,  unlike  tests,  contain  a  large  number  of  constructs 
and  are  content  diversified,  it  is  not  possible  to  make  definitive  statements 
in  this  regard.  Individual  models  will  vary,  within  themselves,  in  the 
degree  of  content  and  construct  validity  they  possess.  Similarly,  if  one 
undertakes  the  assessment  of  the  predictive  validity  or  of  the  concurrent 
validity  of  a  model,  the  result  will  depend  on  which  one  or  several  of  the 
output  measures  he  chooses  to  investigate.  Moreover,  the  magnitude  of 
the  required  correlation  for  "acceptable"  validity  will  vary  with  the  pro¬ 
posed  use  of  the  output.  The  procedure  described  by  Campbell  and  Fiske 
provides  the  solution  to  these  procedural  and  interpretive  problems. 

Assume  that  a  behavioral  simulation  model  will  make  the  following 
predictions  about  performance:  crew  competence,  percentage  of  essential 
tasks  completed,  and  performance  adequacy.  Assume  further  that  inde¬ 
pendent  outside  criteria  are  available  for  each  of  these  output  measures. 
Table  3-2  shows  the  application  of  the  Campbell-Fiske  method  to  this  val- 
idational  problem.  The  cell  entries  in  the  table  are  correlation  coeffi¬ 
cients,  and  criterion  A  and  criterion  B  represent  independent  estimates  of 
the  three  output  measures  of  interest. 

Convergent  validation  implies  a  confirmation  by  independent  meas¬ 
urement  procedures;  in  this  case,  the  predictions  generated  by  the  model 
are  confirmed  by  both  criterion  A  and  criterion  B.  The  demonstration  of 
discriminant  validity  along  with  the  existence  of  convergent  validity  is  re¬ 
quired  for  the  establishment  of  construct  validity.  Convergent  validity  is 
demonstrated  if  the  correlations  in  the  validity  diagonals  (those  entries 
circled  in  Table  3-2)  are  sufficiently  larger  than  zero  and  sufficiently  large 
to  encourage  further  examination.  Evidence  for  discriminant  validity  is 
threefold.  First,  the  correlations  in  the  validity  diagonal  should  be  higher 
than  those  in  the  heteroparameter-heteromethod  triangles,  which  are  in 
solid  lines,  and  in  which  neither  parameter  nor  criterion  method  are  in 
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common.  Second,  the  values  in  the  validity  diagonal  should  be  higher 
than  those  correlations  between  that  parameter  and  other  parameters 
with  a  common  method  of  rating,  i.  e. ,  the  values  in  the  validity  diagonal 
should  be  higher  than  the  values  in  the  heteroparameter- monomethod  tri¬ 
angles  (which  are  in  dashed  lines  in  Table  3-2).  Third,  the  pattern  of 
trait  interrelationships  should  be  the  same  within  and  between  outside  cri¬ 
teria.  In  Table  3-2,  the  same  pattern  of  trait  relationships  is  shown  in  all 
the  heteroparameter  triangles  of  both  the  monomethod  blocks  and  the  heter¬ 
omethod  blocks.  The  above  four  comparisons  can  be  conducted  through 
an  analysis  of  variance  procedure  described  by  Kavanagh  et  al.  (1971). 

Generality 

The  generality  issue  revolves  around  the  question  "Should  the  mod¬ 
el  apply  only  to  one,  specific  system  task,  situation,  or  event,  or  should 
it  apply  to  a  class  of  these  types  of  systems  tasks,  situations,  or  events?  " 
This  question  needs  answering  early  in  the  model  development  cycle  and 
the  answer  will  impact  the  cost  of  model  development,  the  development 
time,  and  the  predictive  validity  of  the  ultimate  model. 

Models  built  to  represent  a  specific  (often  unique)  situation  are 
generally  easier  to  conceptualize,  structure,  and  develop.  Accordingly, 
they  are  less  costly  to  develop  and  the  time  required  for  their  development 
is  less  than  for  a  more  general  representation.  However,  the  applicability 
of  such  models  to  other,  even  similar,  situations  will  be  highly  limited. 
Accordingly,  the  cost  of  "ownership"  for  a  highly  specific  model  is  prob¬ 
ably  allocable  to  the  initial  use. 

On  the  other  hand,  while  more  general  models  are  more  costly  in 
terms  of  developmental  cost,  such  models  are  apt  to  be  used  regularly  by 
a  greater  number  of  users.  For  example,  the  Siegel -Wolf  (1969)  model, 
initially  developed  by  1960  remains  in  use  today.  For  such  models,  the 
cost  of  development,  maintenance,  and  support  can  be  amortized  over  a 
number  of  uses  and  users  and  the  total  cost  of  building  one  general  model 
is  almost  certainly  less  than  the  cost  of  building  several  more  specific 
models. 

However,  there  is  probably  a  trade  off  between  generality  and  val¬ 
idity.  As  generality  increases,  validity  probably  decreases.  Accordingly, 
in  this  problem  area,  as  in  several  of  those  discussed  previously,  the  mod- 
elist  must  come  to  an  early  decision.  Failure  to  do  so,  may  result  in  a 
disjointed  model  with  different  levels  of  generality  included  in  each  subrou¬ 
tine.  Quite  obviously,  the  output  of  a  model  can  be  no  more  general  than 
the  generality  of  its  least  general  subroutine. 
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User  Interface 


If  a  simulation  model  is  to  be  used,  the  user  must  be  able  to  inter¬ 
act  easily  with  the  model.  The  user’s  interaction  with  the  model  will  take 
place  in  one  of  two  forms.  The  user  will  need  to  enter  into  the  model  var¬ 
iable  information  which  describes  the  conditions  of  the  simulation  or  set  of 
simulations  which  he  wishes  performed.  For  example,  the  NETMAN  mod¬ 
el  requires  such  data  as:  operator  proficiency,  operator  level  of  aspiration, 
task  analytic  data,  number  of  messages  arriving  each  hour,  and  number  of 
characters  per  message.  The  second  user  interface,  discussed  in  the  sub¬ 
sequent  section  of  this  report,  occurs  when  the  user  receives  and  must  in¬ 
terpret  the  output  of  the  model. 

At  the  input  end,  several  types  of  data  entry  are  possible,  including 
punched  card,  magnetic  tape,  or  terminal.  The  most  preferred  data  entry 
system  is  the  one  which  is  easiest  for  the  computer  naive  individual  to  em¬ 
ploy.  Input  through  a  terminal  seems  to  meet  this  condition  best.  Of 
course,  this  implies  the  availability  of  a  terminal  to  the  user  and  a  con¬ 
venient  form  of  data  entry.  If  the  terminal's  displays  have  been  designed 
for  user  convenience,  the  user  of  the  terminal  avoids  a  key  punching  step 
and  the  associated  need  to  be  acquainted  with  key  punch  methods  and  card 
formats.  Of  course,  card  (or  tape)  input  can  be  provided  as  a  back  up 
mode  or  for  use  when  an  interactive  terminal  is  not  available. 

The  keys  to  user  convenience  are  clear  and  understandable  terminal 
displays,  full  use  of  cueing  and  menuing  techniques,  clear  error  state¬ 
ments  which  lead  the  user  to  the  appropriate  actions,  the  capability  for 
local  hard  copy,  and  minimizatioh  of  the  required  amount  of  user  supplied 
information.  A  well  designed,  thorough,  and  tested  user  manual  is  also  a 
necessity.  The  user  manual  is  not  a  programmer's  manual  but  rather  a 
nontechnically  oriented  description  of  the  simulation,  what  it  can  and  can 
not  do,  how  to  interpret  the  results  and  how  to  log  on,  enter  data,  correct 
mistakes,  and  run  the  simulation.  One  instructional  presentation  tech¬ 
nique,  employed  by  Applied  Psychological  Services  in  the  development  of 
the  PERFECT  continuous  operations  simulation  (Siegel  et  ai„  1980)  for  a 
print-only  terminal  is  shown  in  Figure  3-2.  In  the  Figure  3-2  example, 
(which  is  the  first  page  of  a  set)  the  user  first  enters  the  command  OLD 
PERFECT  and  presses  the  R  (return)  key  on  the  terminal.  The  computer 
system  responds  with  an  ^(asterisk)  and  the  operator  presses  the  F,  R, 

N,  and  return  keys.  The  computer  responds  with  the  current  time  and  date 
and  the  question  PRINT  OFF  LINE  DATA  AND  INTERMEDIATE  ARRAYS  - 
Y  or  N.  The  operator  responds  Y  (yes)  or  N  (no).  This  step-by-step  pro¬ 
cedure  is  followed  until  the  simulation  is  completed.  The  operator  can  keep 
such  a  procedural  guide  on  his  desk  and  run  the  simulation  with  little  addi¬ 
tional  indoctrination. 
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0,0,0,0,0  R 


■TO  TOP  OF  PAGE  2 


FIGURE  3-2.  PARTIAL  SET  OF  OPERATING  INSTRUCTIONS  FOR  PERFECT 
SIMULATION. 
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it  from  Simulation 


The  output  of  a  model  and  the  interpretation  of  the  output  repre¬ 
sents  the  second  aspect  of  the  operator -mod el  interface.  Here,  it  is  nec¬ 
essary  to  provide  the  user  with  the  decision  oriented  information  he  re¬ 
quires  at  his  desired  level  of  detail  and  in  a  form  which  he  can  use. 

Unfortunately,  it  is  often  not  possible  to  know  the  answers  to  these 
questions  in  advance.  And,  different  users  will  possess  different  require¬ 
ments.  Accordingly,  it  is  best  to  provide  the  user  with  the  option  to  se¬ 
lect  on  the  basis  of  user  input  those  output  tabulations  he  requires.  With 
options  specified  at  run  time,  the  user  has  complete  flexibility  on  the  level 
of  detail  to  review.  To  provide  full  flexibility,  a  minimum  of  three  output 
detail  levels  or  levels  of  data  reduction  of  tabular  results  should  be  pro¬ 
vided: 

w  Full  detail—  full  detail  of  simulation  results  for 

each  event,  time  segment,  operator, 

etc.  simulated.  This  is  particularly 

useful  in  checkout  of  new  input  data 

sequences  or  for  studying  specific 

T  situations  in  detail. 

Increasing 

Level  of  Intermediate — consolidation  of  events  or  time  seg- 
Data  ments  by  hour,-  day,  or  some  con- 

Reduction  venient  scaling.  This  level  is  valuable 

for  archives,  for  allowing  ad  hoc  sum¬ 
maries,  and  for  review  of  general  re¬ 
sults. 

W  Summary--  major  output  summarized  across  events, 

*  time  segments,  days,  operators  and  the 

like. 

On  the  output  recordings  at  each  level,  appropriate  listings  of  initial  con¬ 
ditions  and  parameters  which  generated  the  output  should  be  presented,  if 
only  for  reference  purposes. 

In  addition,  it  is  useful  and  desirable  to  provide  the  output  of 
major  variables  in  graphic  form  or  to  accent  high  and  low  points  in  the 
simulated  performance.  Table  3-3  shows  some  types  of  output  which  should 
be  utilized  at  each  of  the  three  levels  of  simulation. 
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Types  of  Model  Output  Potentially  Available 


Tabular  Lists 


•  Initial  values  and  conditions 

•  Status  of  variables 

•  Identification  information 

•  Present  conditions 

•  Operator/ computer  error  conditions 


•  Average  values 

•  Cumulative  values 

•  Ranges  of  values 

®  Final  (end  of  period)  values 

•  Frequency  distributions  and  probability  of  events 
®  Totals 


•  Variable(s)  vs.  time 

•  Variable(s)  vs.  variable  or  parameter 

•  Frequency  distrubutions,  bar  charts 

•  Pictoral  presentations 

•  Maps,  layouts,  pie  diagrams 

•  Block  diagrams 
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User  Acceptance 

The  problem  of  user  acceptance  of  a  behavioral  simulation  model 
and  its  data  is  a  major  concern  to  the  behavioral  simulation  developer. 

On  the  one  hand,  there  are  users  who  will  say  that  if  the  computer  calcu¬ 
lated  a  result,  the  result  must  be  correct.  On  the  other  hand,  there  are 
those  with  an  "I'm  from  Missouri"  attitude  who  will  believe  that  behavior 
is  too  complex  to  be  represented  by  any  computer  model.  Either  extreme 
represents  an  untenable  attitude. 

How  can  one  assure  user  acceptance?  A  number  of  the  features 
which  should  be  built  into  a  model  in  order  to  assure  its  utility  and  accept¬ 
ability  were  discussed  in  the  preceding  sections.  These  included:  (1) 
minimum  input  data  requirements,  (2)  availability  and  pertinence  of  re¬ 
quired  input  data,  (3)  appropriately  documented  and  structured  program¬ 
ming  in  a  common  language,  (4)  transportability,  (5)  proper  validation,  (6) 
appropriate  level  of  generality,  (7)  output  which  provides  results  at  the  ap¬ 
propriate  level  of  detail,  and  (8)  a  convenient  user  interface. 


At  a  different  level  of  analysis,  some  users  will  want  to  know  the 
details  of  the  steps  involved  in  the  development  of  the  model.  Is  this  an 
ad  hoc  development  or  does  it  represent  the  outcome  of  a  systematic  set 
of  analyses  and  tests?  While  one  can  not  prespecify  the  steps  to  take  in 
the  development  of  any  specific  model,  the  generalized  sequence  of  events 
involved  in  developing  a  behavioral  model  which  is  to  be  used  to  assist  the 
decision  making  process  is  shown  in  Figure  3-3  (Siegel  &  Madden,  1979). 

The  figure  is  read  from  the  bottom  to  top  with  the  considerations 
involved  in  each  stage  entering  from  the  left  of  each  box  and  the  results 
of  each  stage  exiting  to  the  right.  The  number (s)  above  each  Figure  3-3 
box  represent  criteria  which  may  be  applied  after  each  developmental 
stage.  These  criteria  are  defined  in  Table  3-4.  The  rounded  boxes  as¬ 
sociated  with  each  rectangular,  stage  box  represent  descriptors  which 
may  be  applied  as  the  criteria  at  the  successive  stages  are  met.  Accord¬ 
ingly,  a  model  may  be  successively  called  "suitable,  "  "testable,  "  "rea¬ 
sonable,  "  "valid,  "  "effective,  "  and  "useful.  " 
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Cost/  Effectiveness 


The  cost  of  model  development  and  the  cost  of  model  application  rep¬ 
resent  two  distinct  but  interrelated  model  development  considerations.  Both 
depend  heavily  on  the  type  of  model.  Table  3-5  presents  the  several  generic 
types  of  Army  models  (TRADOC  Pam  71-12,  1979).  It  includes  five  types, 
from  the  most  abstract  (analytical  model)  to  the  reality  of  actual  combat. 
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Table  3-4 


Criteria  for  Evaluating  a  Model  During  Its  Development 


Criterion 

1.  Internal  consistency 


2.  Indifference  to  trivial  aggre¬ 
gation 


3.  Correct  prediction  in  the  ex¬ 
treme  (predictive  or  empiri¬ 
cal  validity) 

4.  Correct  prediction  in  mid 
range  (predictive  or  empiri¬ 
cal  validity) 

5.  Construct  validity 

6.  Content  (variable /parameter) 
validity  (fidelity) 

7.  Realism  or  "face  validity" 

8.  Richness  of  output 

9.  Ease  of  use 


10.  Cost  of  development 

11.  Transportability-generality 

12.  Cost  of  use 


13.  Internal  validity  (reliability) 

14.  Event  or  time  series  validity 


Definition 

Extent  to  which  the  constructs  are 
marked  by  coherence  and  similarity 
of  treatment 

Potential  to  avoid  major  changes  in 
output  when  input  groupings  or  con¬ 
ditions  undergo  insignificant  fluctu¬ 
ations. 

Extent  of  agreement  (correctness  of 
predictions )  with  actual  performance 
at  very  high/ low  values  of  conditions 

Like  above  for  middle  range  values 
of  conditions 

Theoretical  adequacy  of  the  constructs 

Extent  to  which  the  variables/ pan-ame¬ 
ers  match  real  life  conditions 

Extent  to  which  selected  content  matches 
each  attribute  included 

Number  and  type  of  output -variables 
and  forms  of  presentation 

Extent  to  which  an  analyst  can  readily 
prepare  data  for,  apply,  and  extract 
understandable  results 

Cost  of  effort  to  conceive,  develop, 
test,  document,  and  support 

Extent  of  applicability  to  different  sys¬ 
tems,  missions,  and  configurations 

Value  of  all  effort  involving  use  of  mod¬ 
el  including  input,  data  processing,  and 
analysis  of  results 

Extent  to  which  outputs  are  repeatable 
when  inputs  are  unchanged 

Extent  to  which  aid  predicts  event  se¬ 
quences 


Three  primary  aspects  of  a  model  (resolution  capability,  responsiveness, 
and  realism),  as  rated  by  the  authors  of  the  TRADOC  handbook,  are  shown 
in  Table  3-5  along  with  a  relative  cost  scaling.  (Note  that  two  of  the  five 
model  types  are  concerned  with  computer  simulation).  The  definition  of 
each  model  type  is: 

Analytical  Model  -  often  prepared  by  an  analyst  at  his 

desk  or  with  a  small  amount  of  com¬ 
puter  support 

Deterministic  Model  -  often  a  series  of  analytic  models,  con¬ 
stantly  updated;  an  "expected  value" 
model  (involves  computer) 

Probabalistic  Model  -  a  "Monte  Carlo"  model  which  simu¬ 
lates  a  series  of  conditions  (uses  com¬ 
puter) 

Manual  Model  -  a  game  played  by  knowledgeable  per¬ 

sonnel  most  useful  for  evaluation  of 
large  forces 

Field  Tests  and  -  live  prearranged  engagements;  real- 

Experiments  istic  yet  simulated. 

To  place  the  five  model  types  into  perspective,  consider  the  cost 
elements,  i.  e. ,  the  tasks  and  resources  involved  in  model  design,  imple¬ 
mentation,  maintenance,  and  utilization.  Table  3-6  itemizes  these  primary 
tasks  and  assigns  a  Y  (yes)  or  N  (no)  to  each  task. 

The  TRADOC  handbook  also  states  that,  at  least  for  combat  simu¬ 
lation,  the  probabalistic  model  (the  type  of  greatest  pertinence  to  this  re¬ 
port)  should  be  the  basic  study  model.  The  deterministic  model  is  a  val¬ 
uable  supplement  but  should  not  be  used  as  the  principal  model  to  support 
a  study  if  a  probabalistic  model  is  available.  Likewise,  analytical  models, 
which  give  a  single  answer  and  not  a  distribution,  can  be  misleading;  but, 
they  too  serve  an  important  function  if  used  to  supplement  models  of  higher 
resolution  and  are  preferable  if  no  other  suitable  models  are  available. 

The  manual  model  (e.  g. ,  war  games)  are  of  greatest  value  and  the  primary 
tool  for  simulating  large  forces  but  may  be  partially  replaced  by  computer 
simulations  for  levels  below  the  battalion.  The  principal  value  of  field  tests 
and  experiments  is  to  serve  as  a  source  of  data  for  input  to  other  model 
types. 

In  connection  with  the  development  of  the  NETMAN  model,  computer 
running  costs  were  analyzed  (Siegel,  Leahy,  &  Wolf,  1979).  The  cost  of 
computer  time  for  model  development  was  only  a  s:  .ill  portion  of  the  total 
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Table  3-6 


Design  Tasks  for  Each  TRADOC  Type  of  Model 


Tasks 

Model  Design  --  Once 


Define/ conceive  model 
Determine  information  and  data 
requirements 

Collect  information  and  data  for  model 
Define  parameter/ variable  types 
Define  inputs/ outputs 
Define  functional  relationships 
Validate  model  concepts 

Model  Implementation  --  Once 


Develop  model  flow  charts 
Select  computer  language 
Prepare  programming  specs 
Program,  code,  and  test  model 
Perform  model  sensitivity  test 
Perform  model  validation  test 
Document  the  model 

Model  Maintenance  --  Continuin 


Enhance  with  new  features 


s-sh-sl 

ISsskss 


Y  Y 

low  Y 

Y  Y 


Model  Utilization  --  Upon  Each  Need 


Data  collection/ parameter  selection 
Execute  computer  runs  - 

Make  calculations 

Analyze,  illustrate,  evalutate  results 
Draw  conclusions,  make  recommendations 


Y 

Y 

Y 

Y 

N 

Y* 

y#* 

N 

Y 

N 

N 

N 

Y 

Y 

Y 

Y 

Y 

Y 

Y 

Y 

*  Rapid 


**  Slower 


development  cost.  This  is  considered  typical.  Thus,  in  the  model  devel¬ 
opment  phase,  cost  of  personnel  resources  usually  far  exceeds  computer 
costs.  In  model  application  (i.  e. ,  utilization),  computer  use  costs  are 
dependent  on  time  of  day,  extent  of  CPU  and  memory  required,  terminal 
vs.  batch  operations,  billing  policies,  and  the  like.  Primarily  costs  are 
dependent  on  the  number  of  runs  and  run  combinations  selected.  However, 
the  unit  cost  for  a  computer  run  of  a  well  programmed  model  is  also  quite 
modest.  Thus,  combining  this  information,  we  find  that  the  model  types 
which  cost  less  traditionally  yield  less  value  and  that  multiple  model  types 
may  often  be  called  for  an  analysis  of  a  specific  situation. 


At  the  present  state-of-the-art  for  modeling,  the  decision  as  to 
which  type  or  types  of  models  to  develop  and  maintain  on  a  cost/ utility  or 
cost/ effectiveness  basis  must  still  be  made  on  a  case-by-case  basis. 
Often  personal  safety,  test  site  availability,  types  of  personnel  skills 
(analytical,  programming)  and  computer  equipment  available  as  well  as 
time  schedule  requirements  (rather  than  an  analysis  of  which  type  of  mod¬ 
el  is  best  solely  on  the  basis  of  the  cost  and  effectiveness)  may  determine 
the  type  of  model  selected  for  a  given  application. 

Some  of  the  relationships  involved  in  computer  model  costing  are: 


Life  Cycle -Cost 

LCC  =  MDC+MTC+MMC+2  MUC 

n  n 

Model  Development  Cogt 

MDC  =  MCC+MPC+MDAC+MDDC 

Model  Test  Cost 

MTC=  MSTC+MVTC 

Model  Maintenance  Cost 

MMC  =  MEC+MECC  +  MMDC 

Model  Utilization  Cost 

MUC  s  RSC+?  (CMC.  •  CTR  ) 

J  J  J  “ 

Model  Conceptualization  Cost 

MCC  =  (?DLH.  •  DLR.)  +MTO 
i  x  x  c  c 

Model  Programming  Cost 

MPC  =  (2  PLH.  •  PLR.)  +  2 CMC.  *  CTR.+MTO 
l  1  1  P  j  J  J  P 

Model  Sensitivity  Test  Cost 


MSTC  =  Z  (TLH.  •  DLR.)s  +  (CMC..  •  CTR^+MTC^ 
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Model  Validation  Test  Cost 


MVTC  =  2  (TLH. 

1  1 


DLR.)v+(CMC. 

J 


CTR.)  +MTO 
3  s  s 


where: 


MDC 

MTC 

MMC 

n 

MUC 


Model  Development  Cost 

Model  Test  Cost 

Model  Maintenance  Costs 

Number  of  Model  Applications  or  Uses 

Cost  of  Model  Use 


MCC 

MFC 

MDAC 

MDDC 

MSTC 

MVTC 

MEC 

MECC 

MMDC 


DLH 

DLR 

MTO 

PLH 

PLR 

CMC. 

J 


CTR. 

3 

TLH 

TLR 


=  Model  Conceptualization  (problem  definition)  Cost 
=  Model  Programming  Cost 
=  Model  Data  Acquisition  Cost 
=  Model  Design  Documentation  Reporting  Cost 

=  Model  Sensitivity  Test  Cost 
=  Model  Validation  Test  Cost 

*  Model  Enhancement  Cost 

=  Model  Error  Correction  Cost 
=  Model  Maintenance  Documentation  Cost 

*  Conceptualization  Phase 
=  Programming  Phase 

=  Sensivity  Test  Phase 
=  Validation  Test  Phase 
=  Utilization  Phase 

=  Personnel  Types  Involved 

=  Design  Labor  Hours 

=  Design  Labor  Rate 

=  Material,  Travel,  and  Other  Costs 

=  Programming  Labor  Hours 
=  Programming  Labor  Rate 

=  Cost  of  Computer  Related  Elements.,  Per  Unit  Time 
(computer,  memory,  line  costs)  •* 

=  Types  of  Computer  Related  Costs 

=  Time  Required  of  Computer  Related  Elements. 

■  3 

=  Test  Labor  Hours 
=  Test  Labor  Rates 


RSC 


=  Run  Setup  Cost 
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Other  Pervasive  Issues 


The  fundamental  ingredients  for  any  behavioral  simulation  which 
purports  to  be  at  all  complete,  were  presented  earlier.  However,  a  num¬ 
ber  of  more  vexing  issues  remain  to  be  discussed.  These  issues  repre¬ 
sent  areas  in  which  there  is  possibly  less  agreement  among  behavioral 
modelists  and  which,  accordingly,  must  be  given  greater  critical  consid¬ 
eration  during  model  development. 


Type  of  Model  as  a  Function  of  Human  Characteristics  to  be  Simulated 

Earlier  the  distinction  was  made  between  functional  and  psycho¬ 
logical  representations  within  a  model.  Psychological  models  were  de¬ 
picted  as  representation  through  higher  order  constructs  which  impact  the 
model's  throughput  or  events  simulated.  Functional  models  were  describ¬ 
ed  as  more  or  less  direct  representations  of  the  events,  physical  attrib¬ 
utes,  or  throughput.  The  contrast  between  the  two  approaches  may  be 
visualized  as  shown  in  Figure  3-4.  The  question  to  be  answered  concerns 
the  appropriateness  of  the  psychological  or  functional  models  for  repre¬ 
senting  human  behavior.  (Here,  we  note  that  in  actual  practice  the  mixed 
model  will  most  often  be  constructed.  Nonetheless,  the  dichotomy  is  use¬ 
ful  at  least  during  the  early  stages  of  model  planning. ) 

The  variables  built  into  behavioral  models  can  be  categorized  as 
cognitive,  conative,  perceptual,  emotional,  and  motor.  Because  psycho¬ 
logical  models  depend  on  the  availability  of  behavioral  theory,  it  is  nec¬ 
essary  to  evaluate  the  status  of  the  theory  available  in  each  of  these  cate¬ 
gories.  Specifically,  for  model  development  purposes,  four  questions 
must  be  answered  about  each  behavioral  category: 

1.  What  is  the  adequacy  of  behavioral  theory? 

2.  If  competing  theories  are  available,  is  it  possible 
to  make  a  choice  among  them? 

3.  Can  a  selected  theory  be  represented  through  com¬ 
puter  simulation;  i.  e.,  is  the  selected  theory  amen¬ 
able  to  mathematical  or  functional  representation? 

4.  Are  the  necessary  input  data  available  or  obtainable 
at  a  sufficient  level  of  reliability/ validity ? 
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FIGURE  3-4.  DATA  FLOW  IN  FUNCTIONAL,  PSYCHOLOGICAL,  AND  MIXED 
MODELS. 
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Table  3-7  presents  an  evaluation  of  eac-h  behavioral  category  against 
each  of  the  critical  questions.  Table  3-7  suggests  that  the  perceptual, 
motor,  and  cognitive  categories  are  presently  most  amenable  to  psy¬ 
chological  simulation.  The  conative  and  emotional  categories  are 
judged  to  have  considerably  less  well  developed  theory  and  data  avail¬ 
ability.  They  are  therefore  judged  to  be  less  amenable  to  representa¬ 
tion  in  current  behavioral  computer  simulation. 

Individual  Difference  Representation 

One  inherent  advantage  of  behavioral  simulation  rests  in  its 
ability  to  represent  within  and  between  individual  variations  as  part  of 
the  simulation.  (Within  individual  variations  refer  to  the  fact  that  on 
two  different  occasions  individuals  seldom  perform  the  same  act  in 
precisely  the  same  manner  or  time.  Between  individual  differences 
refer  to  ability  differences  among  persons.  Some  people  learn  faster 
than  others;  some  work  faster  than  others,  etc.  ) 

The  within  individual  variation  problem  is  generally  managed 
through  the  introduction  of  distributions,  rather  than  points,  into  the 
simulation  process.  For  example,  rather  than  enter  as  input  a  given 
time  duration  (  X  )  to  perform  a  given  event,  a  mean  (  X  )  and  a  stand¬ 
ard  deviation  ( tr  )  are  entered  or  calculated.  During  the  simulation  of 
the  event,  a  random  number  is  drawn  from  a  preselected  distribu¬ 
tion.  (When  the  normal  distribution  is  used,  this  random  number  is 
called  a  random  deviate.  )  The  actual  event  performance  time  to  be 
employed  in  a  simulation  may  then  be  determined  on  the  basis  of  X,  o" 
and  the  random  deviate.  The  result  is  a  stochastically  selected  per¬ 
formance  time  for  the  simulated  event.  Obviously,  the  random  number 
distribution  need  not  be  normal.  Most  frequently,  uniform  normal, 
Poisson,  and  rectangular  distributions  are  employed.  Most  computer 
systems  offer  callable  routines  to  generate  random  numbers  selected 
fi  ,m  these  distributions.  Because  of  the  random  number  generation 
process,  a  large  number  of  simulations  may  be  needed  in  order  to  ob¬ 
tain  a  stable  result  when  such  a  scheme  is  employed. 

In  general,  the  problem  of  differences  between  individuals  is 
handled  through  input  which  serves  to  "adjust"  the  simulation  in  accord¬ 
ance  with  the  type  of  person  to  be  simulated.  Several  examples  of  this 
type  of  manipulation  follow; 


•  In  the  Siegel-Wolf  (1969)  model,  an  input  value  is 
entered  to.  represent  the  proficiency  of  the  persons 
simulated.  This  value  is  scaled  from  0.5  to  1.5 
to  represent  various  levels  of  proficiency.  The  in¬ 
put  values  act  multiplicatively  on  response  time  and 
success  probability  distributions  with  the  end  result 
that  more  proficient  simulated  operators  "work  fas¬ 
ter"  and  "make  fewer  errors.  "  Separate  computer 
runs  are  completed.  Each  of  these  is  completed 
with  a  different  proficiency  value.  Comparison  of 
the  results  from  the  separate  runs  allows  a  com¬ 
parison  of  the  effects  of  between  individual  differ¬ 
ences  in  proficiency  on  task  success. 

•  In  a  large  group  simulation  model,  (Siegel,  Wolf, 
Barick,  &  Miehle,  1964),  three  types  of  "orienta¬ 
tion"  (towards  self,  towards  unit,  towards  mission 
success)  are  entered  for  each  person  simulated  and 
for  each  task.  To  simulate  the  effects  of  differences 
between  individuals  in  "motivation"  on  perform¬ 
ance,  the  simulation  compares  the  orientation  mix 

of  the  individual(s)  simulated  with  the  orientation  of 
the  task  and  performance  effectiveness  and  is  adjusted 
in  accordance  with  the  results  of  this  comparison. 

The  end  result  is  that  performance  effectiveness  is 
superior  for  persons  whose  orientation  matches  the 
orientations  of  the  task  and  is  inferior  where  there  is 
a  mismatch  between  the  orientation  of  the  task  and 
that  of  the  individual(s)  performing  the  task. 

•  In  an  intermediate  size  crew  model  (Siegel,  Wolf,  & 
Cosentino,  1971),  the  effects  of  between  leader  differ¬ 
ences  in  performance  expectation  on  performance  ef¬ 
fectiveness  are  simulated.  The  leader's  expectation 
value  reflects  the  leader's  expectation  of  perform¬ 
ance  effectiveness  on  the  basis  of  the  competency  of 
the  individual  performing  the  task.  To  accomplish  the 
simulation,  the  performance  effectiveness  (as  calculat¬ 
ed  by  the  simulation)  is  compared  with  a  leader's  ex¬ 
pectation  value  which  is  entered  as  an  input  parameter. 
Task  performance  effectiveness  is  then  adjusted  on  the 
basis  of  the  discrepancy.  Comparison  of  the  results  of 
separate  runs  with  varying  input  leadership  expectation 
values  permits  the  study  of  the  effect  of  leaders  expecta¬ 
tion  independent  of  other  aspects. 


•  Several  of  these  and  other  models  contain  an  individual 
stress  tolerance  value  to  reflect  individual  differences 
in  reaction  to  stress.  The  stress  tolerance  value  serves 
to  indicate  an  individual  stress  threshold.  When  situa¬ 
tional  stress  reaches  this  threshold,  performance  effec¬ 
tiveness  deteriorates.  As  a  result  of  this  implementa¬ 
tion,  individual  differences  in  stress  tolerance  may  be 
compared  by  means  of  the  simulation. 


Changes  Over  Time 


Our  ability  to  store  and  to  retrieve  data  in  high-speed  digital  com¬ 
puters,  and  to  employ  the  retrieved  values  as  the  basis  for  subsequent  cal¬ 
culations  makes  the  simulation  of  changes  over  time  quite  feasible.  Given 
an  adequate  data  base,  almost  any  time  dependent  effect  can  be  built  into 
a  behavioral  simulation  model.  However,  the  critical  point  lies  in  making 
judgments  about  the  adequacy  of  the  data  base.  The  data  base  may  have 
been  derived  from  laboratory  experiments  which  bear  little  relationship 
to  the  time  dependent  relationships  in  the  model  user's  situation.  For  ex¬ 
ample,  does  "normal"  fatigue  data  apply  to  behavior  on  the  integrated  bat¬ 
tlefield? 


Parameter  Estimates 

The  inclusion  in  a  model  of  a  feature  which  allows  user  choice  of 
parameter  ranges  for  simulation  is  highly  desirable  because  such  a  fea¬ 
ture  allows  considerable  flexibility  in  model  use  and  enhances  model  util¬ 
ity.  But,  the  more  extensive  the  parameter  choice,  the  more  the  follow¬ 
ing  question  is  raised:  Is  adequate  information  available  to  the  model  de¬ 
veloper  so  that  he  can  provide  a  reasonable  subset  choice? 

•  Some  types  of  parameter  options  can  be  selected  for  in¬ 
clusion  in  a  model  with  little  concern  for  the  question. 

For  example,  the  parameter:  "number  of  men  in  the 
crew"  is  a  powerful  one  from  the  point  of  view  of  use  of 
model  output.  Inclusion  of  the  parameter  in  a  model 
merely  requires  the  selection  of  several  integers  over 
the  range  of  potential  interest.  No  research  or  labora¬ 
tory  experimentation  is  required  in  order  to  provide 
values  for  this  input  parameter. 

•  Other  parameter  selection  options  may  be  provided  if  a 
literature  search  shows  the  availability  of  experimental 

.  data  or  appropriate  data  banks.  Alternately,  if  no  data 

appear  to  be  available,  the  cost  of  developing  the  data 
via  tailored  experimentation,  calculation,  or  other 
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techniques  should  be  evaluated.  It  is  poor  policy  to 
choose  variables  for  modeling  if  (1)  the  user  has  no 
way  to  select  input  values  or,  (2)  if  he  cannot  relate 
these  variables  to  real  world  conditions.  However, 
no  matter  how  extensive  the  extant  data  may  be,  it 
may  not  be  possible  to  satisfy  all  purists  on  the  mat¬ 
ter  of  data  adequacy. 

•  Another  approach  to  parameter  range  estimation  could 
be  through  application  of  the  Delphi  technique.  Here, 
a  series  of  persons  experienced  in  the  parametric  as¬ 
pects  of  interest  are  asked  to  quantify  their  experience 
under  selected  conditions. 

•  Parameter  range  selection  is  also  possible  through 
informal  measurement.  A  quasi  real  life  situation  in¬ 
volving  the  specific  parameter(s)  of  interest  is  devised 
and  subjects  are  measured  on  performance  in  the  sit¬ 
uation.  The  results  are  used  as  a  basis  for  parameter 
range  estimation. 

Human  Variables 

Simulations  involving  behavioral  variables  and  small  groups  have 
been  in  use  at  least  since  the  mid  1950s.  Table  3-8  was  prepared  to  iden¬ 
tify  some  human  behavioral  oriented  variables  which  are  suitable  for  use 
in  behavioral  person-machine  simulations.  Which  of  these  or  others  is  to 
be  utilized  in  a  simulation  model  is  a  matter  to  be  determined  in  each  spe¬ 
cific  case  and  depends  upon  a  variety  of  considerations  including  the  fol¬ 
lowing: 

•  size  of  group  or  crews  to  be  simulated 

•  time  increment  and  mission  duration  to  be  simulated 

•  environmental  or  other  conditions  to  be  simulated 

•  type  of  mission/  system  to  be  simulated 

e  level  of  generality  planned  for  the  model 

•  resources  and  capabilities  available 

•  time  available  for  model  development/testing 

•  desired  response  time  for  model  utilization 

Situational  Variables 

The  interaction  of  human  performance  characteristics  (simulated 
by  the  human  variables)  with  situational  variables  assumes  importance  when 
such  variables  may  differentially  affect  human  performance.  The  selection 


Table  3-8 


Examples  of  Possible  Behavioral  Variables 


Information  Processing 

memory 
analytic  ability 
inductive  reasoning 
deductive  reasoning 
comprehension 
remote  association 
ability  to  see  consequences 
general  intelligence 
evaluative  ability 
rationality 

Flexibility -Adaptability 

creativity 
ideational  fluency 
teamwork 

enterprising  orientation 

Personal  Traits 

carelessness 
practical  values 
inve  s  ti  gati  ve  ness 
need  for  autonomy 
need  for  change 
need  for  order 
harm  avoidance 
impulsivity 

Psychomotor  Coordination 

speed  of  arm  movement 
wrist  or  finger  speed 
reaction  time 
arm-hand  steadiness 
aiming 

finger  dexterity 
manual  dexterity 
control  precision  (large  move' 
ments  with  fine  control) 


Psychomotor  Coordination  (con't) 

multilimb  coordination 
rate  control 
static  strength 
dynamic  strength 
explosive  strength 
trunk  strength 
extent  strength 
dynamic  flexibility 
body  coordination 
gross  body  equilibrium 
stamina 
running  speed 

Personnel  Management  and  Interaction 


self  evaluation 

evaluation  of  others 

self  confidence 

social  intra-extraversion 

expressional  fluency 

restraint 

ascendence 

sociability 

emotional  stability 

friendliness 

personal  relations 

leadership  style 

orderliness 

dedication  to  goals  of  installation 

dedication  to  goals  of  USA 

family  ties 

moral  values 

crime  involvement 

alcoholism 

drug  addiction 

self  control 

cooperation 

perceived  social  climate 
personal  power 
persuasiveness 
training 
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Table  3-8  (cont. ) 


Personal  Characteristics 

intellective  ability 
training/  proficiency 


Group  Characteristics 

cohesiveness 

morale 

leadership 

communication 
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of  situational  variables  for  inclusion  in  a  model  is  dependent  on  the  char¬ 
acter  of  the  model  planned  and  the  subject  matter  of  the  system  being  sim¬ 
ulated.  Table  3-9  presents  situational  variables  which  have  been  incor¬ 
porated  into  various  behavioral  models.  Table  3-9,  of  course,  is  not  com¬ 
plete.  Situational  variables  may  be  as  diverse  and  numerous  as  the  types 
of  systems  for  potential  simulation. 

The  use  of  situational  variables  lends  significant  realism  to  a  model. 
However,  the  model  builder  should  remember  that:  (1)  pseudo  realism 
can  be  easily  brought  to  an  excess  to  the  detriment  of  the  model  and  all 
concerned,  and  (2)  the  true  test  of  a  model  is  its  ability  to  assist  in  deci¬ 
sion  making  and  not  the  number  of  relational  equations  which  give  the  ap¬ 
pearance  of  reflecting  the  real  world. 


Table  3-9 


Examples  of  Situational  Variables 


System  Characteristics 

queue  length 
safety  level 

distance  between  entities 

communications  network 

procedures 

failure  rate 

repair  time 

redundancy  level 

time  used,  idle,  inoperable 

type 


Supply 

frequency 

rate  of  consumable  use 
amount  of  resupply 

Opposing  Force 
number 

type  of  weapons 
weapon  mix 
sensors 


Environme  nt 

heat 

light 

ventilation 
terrain  features 
sea  state 
air  smoothness 


Management  Actions 

work  day  length 
watch  length 
personnel  policy 
promotion  policy 
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IV.  CURRENT  STATUS  AND  FUTURE  TRENDS 
_  IN  BEHAVIORAL  MODELING 


Current  Trends  and  Status 


The  status  of  the  stochastic  computer  simulation  technology  is 
such  that  this  approach  now  represents  a  generally  accepted  tool  for 
system  effectiveness  prediction.  This  holds  whether  economic,  social, 
person-machine,  or  other  systems  are  involved.  Standard  texts  in 
industrial  design  (e.g. ,  Forrester,  1961)  recommend  the  use  of  the  tech¬ 
nique,  as  do  current  texts  in  human  factors  engineering  (e.  g. ,  McCormick, 
1964).  For  human  involved  systems,  various  agencies  have  come  to  rely 
more  and  more  on  the  use  of  such  models.  Examples  of  the  use  of  prior 
models  by  the  military  include  sonar  system  and  aircraft  design  in  the 
Navy,  advanced  aircraft  design  in  the  Air  Force;  communications  system 
investigation  in  the  Army,  and  fire  control  system  design  in  the  Navy.  All 
of  these  applications  include  circumstances  in  which  the  use  of  other  types 
of  predictive  methods  are  untenable,  uneconomical,  or  impossible. 

Feiler  made  the  following  comment  on  simulation  in  manpower 
planning  in  1971.  It  has  since  been  followed  by  many  others  in  dozens  of 
areas  and  remains  representative  of  current  thought:  "General  purpose 
computer  simulation  has  been  demonstrated  by  many  applications  to  Navy 
problems --to  be  a  useful  and  efficient  tool  for  manpower  and  personnel 
planning.  It  is  competitive  with  special-purpose  simulation  for  certain 
problem  applications;  it  is  uniquely  suited  to  others.  " 


Similarly,  Smillie  &  Ayoub  (1980)  found  that  "computer  simulation 
can  indeed  be  used  as  a  viable  alternative  to  laboratory  experimentation.  " 
Their  study  "exemplified  the  fact  that  the  computer  simulation  provides 
the  job  performance  aid  designer  and  evaluator  with  a  means  by  which  he 
can  assess  and  evaluate  different  job  performance  aid  format  combinations 
under  varying  conditions.  " 

McLeod  (1968)  saw  a  very  bright  future  for  simulation  in  general, 
even  at  that  relatively  early  date: 

However,  no  matter  how  1  strain,  I  see  nothing 
which  might  limit  the  current  exponential  increase  in  the 
influence  of  simulation  on  our  way  of  life  in  years  to  come. 

The  use  and  acceptance  of  models,  as  he  and  others  predicted,  has  in 
fact,  come  to  pass.  This  trend  has  been  followed  for  both  behavioral  mod¬ 
el  and  for  models  in  other  fields. 
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This  trend  toward  greater  use  of  modeling  will  continue  throughout 
at  least  the  first  half  of  the  1980s  due  to  the  following  representative  re¬ 
lated  technological  trend  developments  whose  impact  has  not  yet  been 
fully  realized: 

•  exponential  growth  in  the  availability  of  computational 
power  due  to  reduced  hardware  costs 

•  wide  acceptance  of  and  significant  growth  of  educational 
processes  leading  to  today's  computer  scientist.  This 
is  related  to: 

(1)  the  current  acceptance  of  the  computer 
field  as  a  science  rather  than  an  art 

(2)  the  development  of  many  theoretical  un¬ 
derpinnings  of  the  field  (e.  g. ,  structured 
programs,  correctness  proofs) 

(3)  the  explosive  growth  of  the  number  of  train¬ 
ed  personnel  in  analysis,  and  programming 

•  the  impact  of  on-line  program  development  and  mainten¬ 
ance,  as  well  as  on-line  conversational  program  runs 

'  •  the  orders-of-magnitude  reduction  in  the  cost  per  bit  of 
storage,  the  cost  per  bit  per  second  of  long-distance 
transmission  and  the  basic  cost  of  computation  per  unit 
arithmetic/  logical  operation 

•  the  feasibi’ity  of  transmitting  large  volumes  of  data  over 
long  distances 

•  improved  computer  system  reliability  via  redundancy,  er¬ 
ror  correction,  fault  tolerant  operating  systems,  and  com¬ 
ponent  count  reductions 

•  the  adoption  of  federal  standards  for  programming  lan¬ 
guages,  storage  media,  transmission  interface  protocols 
and  the  like 

•  the  drastic  reduction  in  the  volume  of  space  required  by 
computing  equipment  coupled  with  corresponding  reductions 
in  power  (operating)  costs 


Although  the  art  of  behavioral  model  development  has  advanced  over 
the  years  and  although  behavioral  modeling  has  seen  increased  application, 
a  wide  variety  of  concerns  still  remain  open.  As  with  any  evolving  area, 
there  is  often  disagreement  on  methods,  emphasis,  and  concepts.  While 
the  thrust  of  the  present  report  supports  and  encourages  the  use  of  behav¬ 
ioral  models,  we  are  also  aware  that  economists  have  devoted  considerable 


effort  to  econometric  simulations  with  limited  successes.  While  such 
models  are  freely  employed  to  predict  the  state  of  the  economy,  six 
months  or* even  a  year  from  now,  experience  tells  us  that  they  often  fail 
to  predict  even  what  will,  in  fact,  happen  next  month  or  even  tomorrow. 

Thus,  not  all  simulation  developments  have  met  with  uniform  suc¬ 
cess.  But,  the  fact  that  these  and  other  forecasts  (including  several  be¬ 
havioral  simulations)  have  not  been  wholly  utilitarian  has  not  and  should 
not  disuade  or  discourage  users  from  seeking  the  best  advice  available. 
While  the  state-of-the-art  in  behavior  modeling  may  be  primitive,  the 
initial  behavior  modeling  successes  and  the  improvements  achieved  in 
forecasting  by  other  fields  offer  promise  for  better  behavioral  forecasts 
in  the  future. 

Future  Trends 

In  earlier  sections,  the  following  expected  future  trends  in  be¬ 
havioral  modeling  were  introduced  and  described; 

•  Increased  development  and  use  of  models.  Expansion 
in  quantity  and  diversity  of  models  is  anticipated. 

•  Increased  cost/ effectiveness  due  to  decreased  computer 
equipment  (time)  •  a  component  of  total  model  cost. 

"While  the  hardware/ software  cost  ratio  continues  to  de¬ 
crease  and  level  off,  the  cost  or  availability  of  computer 
equipment  will  decrease  effectively  to  only  a  small  per¬ 
centage  of  total  simulation  costs. 

•  Increased  availability  of  easy  to  use,  general  purpose 
programming  languages  as  primary  vehicles  for  simu¬ 
lation  programs. 

•  Decreased  diversity  of  models  by  category,  solution 
technique,  advance  method,  and  by  type.  There  seems 
to  have  been  as  many  techniques  applied  as  have  been 
conceived.  This  is  attributed  to  the  newness  of  the  field 
and  the  concepts.  As  time  progresses,  less  diversity  is 
projected  with  some  model  types  proving  their  value  in 
specific  applications  and  becoming  local  favorites. 

From  a  user's  standpoint,  the  use  of  on-line  computer  terminals  is 
another  significant  trend.  In  the  future,  it  is  anticipated  that  terminals  for 
simulation  control  (initiation,  changes,  and  output)  will  be  used  almost  ex¬ 
clusively.  The  use  of  graphic  (either  black  and  white  or  color)  terminals 
for  displaying  graphs,  maps,  functions,  bar  charts,  and  the  like  (as  well 
as  tables  and  text)  will  be  common.  Direct  hard  copy  recording  will  also 
be  a  user  option.  Networking,  to  allow  the  use  of  large  host  computers, 
can  also  be  anticipated. 


The  physical  shrinkage  of  the  computational  equipment  involved  in 
simulation  is  anticipated  to  continue.  It  will  be  manifested  in  the  follow¬ 
ing  ways: 

•  Minicomputers,  super  minicomputers,  and  micro  com¬ 
puters  will  proliferate.  They  will  be  further  concate¬ 
nated  into  a  myriad  of  configurations  via  local  and  long 
distance  networks,  resulting  in  genuine  distributed  proc¬ 
essing,  and  access  to  powerful  capabilities  with  small 
investments. 

•  The  resultant  miniaturization  will  allow  direct,  physical 
integration  of  powerful  computing  elements  into  comput¬ 
er  terminals,  printers,  and  plotting  devices  in  the  same 
way  that  the  microprocessor  has  already  invaded  the 
wristwatch.  Thus,  in  the  future,  the  computer  per  se 
will  be  an  adjunct,  allowing  devices  like  a  "smart  plotter" 
(plotter  with  a  built-in  computer)  or  a  "smart  terminal" 
to  perform  simulations  now  reserved  for  independent 
large  computers- . 

As  the  use  of  behavioral  simulation  continues  to  accelerate,  and  we 
become  more  and  more  accustomed  to  the  artificial  (simulated)  slowing 
down  of  fast  processes  and  speeding  up  slow  processes,  common  sense 
regard  for  the  reasonableness  of  each  model's  output  will  be  necessary. 
As  stated  by  Frosch: 

Considering  the  present  and  anticipated  rate  of  socio¬ 
cultural  changes  in  cur  society,  I  believe  thes.e.  con¬ 
ceptual  considerations  of  purpose,  scope,  degree  of 
abstraction  and  time  scaling  are  particularly  impor¬ 
tant.  Otherwise,  we  will  continually  find  ourselves 
committing  one  of  the  sins  of  simulation,  i.  e. ,  for¬ 
getting  that  situations  are  imaginary  and  pretending 
that  all  the  data  are  real.  This  is  one  of  the  real 
dangers  of  using  R&D  simulations  for  operational 
purposes  when  they  are  in  fact  still  very  much  in 
the  development  phase  (1971). 


Future  Behavioral  Modeling  Research  and  Development  in  the  Army 

Given  the  emphasis  on  system  models  in  the  Army  and  the  current 
status  of  behavioral  modeling,  what  can  be  said  about  areas  of  future  re¬ 
search  and  development  emphasis  for  behavioral  modeling  in  the  Army? 
On  the  basis  of  the  prior  review,  it  seems  that  the  Army  needs  relative  to 
behavioral  simulation  modeling  fall  into  at  least  five  areas: 
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•  Wider  understanding  of  utility  of  and  progress 
in  behavioral  simulation. 

•  Greater  use  of  behavioral  variables  in  general 
simulation  models. 

•  More  applicable  and  comprehensive  databases. 

•  Availability  of  general  simulation  modules. 

•  Compatibility  with  emerging  mini/ micro  com¬ 
puter  technology. 

These  needs  are  described  in  greater  detail  in  subsequent  sections. 
Where  the  phrases  "near  term,"  "mid  term,"  and  "long  term"  are  used, 
the  respective  implications  are:  "about  one  year,"  "about  2  to  4  years," 
and  "about  5  to  8  years." 


Wider  Understanding  of  Utility  of  and  Progress  in  Behavioral  Simulation 

The  failure  of  Army  system  mode  lists  to  include  human  behavioral 
variables  within  their  system  models  suggests  a  lack  of  understanding  on 
the  part  of  these  persons  about  the  current  status  of  human  behavioral  mod¬ 
eling  and  about  the  contribution  that  such  models  can  make  to  the  enhance¬ 
ment  of  the  utility  of  current  Army  system  models. 


NEED 


Full  dissemination  of  information  about  status  and  power  of  behav 
ioral  modeling. 


METHOD 

TIME  PHASE 

A  set  of  seminars,  brochures,  and 
training  sessions  is  developed 
and  presented  to  industrial  and 
military  developmental  personnel 
relative  to  behavioral  modeling. 

Near  term 

PERSONNEL  REQUIREMENTS 

END  PRODUCTS 

1.0  person  year 

Broader  understanding  by  plan¬ 
ners  of  the  role  of  behavioral  mod¬ 
eling  and  increased  use  of  behav¬ 
ioral  modeling  in  Army  system  plan¬ 
ning  and  evaluation. 
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Greater  Use  of  Behavioral  Variables  in  General  Simulation  Models 


Those  most  frequently  employed  current  Army  system  simulation 
models  should  be  identified  and  analyzed  to  determine  which  behavioral 
variables  seem  most  relevant  to  their  purposes  and  content.  For  each 
frequently  employed  system  simulation  model,  compatible  behavioral  sim¬ 
ulation  modules  (including  man-in-the-loop  simulation)  should  be  developed 
so  as  to  allow  integrated  output  which  considers  both  the  behavioral  and 
the  equipment  variables. 


NEED 

Behavioral  modules  which  interact  with  frequently  employed  Army 
system  simulation  models. 

METHOD 

The  most  frequently  employed  Army 
system  simulation  models  are  iden¬ 
tified.  These  are  analyzed  to  de¬ 
termine  salient  behavioral  vari¬ 
ables.  Behavioral  modules  are  de¬ 
veloped  to  represent  these  vari¬ 
ables. 

TIME  PHASE 

Mid  term 

PERSONNEL  REQUIREMENTS 

3.5  person  years 

END  PRODUCTS 

Army  system  simulation  models  which 
interactively  consider  both  equip¬ 
ment  and  behavioral  variables. 

More  Applicable  and  Comprehensive  Data  Bases 


No  behavioral  simulation  model  can  produce  useful  output  unless  a 
relevant  data  base  is  available  for  providing  the  required  input.  Such  a 
data  base  should  be  based  on  Army  personnel  and  be  periodically  updated 
as  new  data  become  available.  Model  users  cannot  be  expected  to  develop 
their  own  data  bases  and  the  most  carefully  developed  model  can  be  ren¬ 
dered  useless  if  inappropriate  data  are  employed  in  its  implementation. 


86 


NEED 


Data  bases  for  all  Army  developed  behavioral  simulation  models. 


METHOD 

Variables  within  current  Army  be¬ 
havioral  simulation  models  are  iso¬ 
lated.  Variables  within  anticipat¬ 
ed  models  are  similarly  derived.. 
Required  data  for  supporting  such 
variables  are  developed  from  liter¬ 
ature  and  from  formal  measurements. 

TIME  PHASE 

Mid  to  long  term 

PERSONNEL  REQUIREMENTS 

3.0  person  years 

END  PRODUCTS 

Full  data  bases  to  support  current 
and  anticipated  behavioral  simu¬ 
lation  models. 

Availability  of  General  Simulation  Modules 

It  is  possible  to  build  a  set  of  generic  modules  which  can  serve  as 
"off-the-shelf"  plug  ins  to  system  models.  Examples  of  such  generic 
modules  are  stress  effects,  group  cohesiveness,  and  the  effects  of  fatigue. 
Given  the  availability  of  such  modules,  system  modelists  could  then  call 
them  in  much  the  same  way  that  various  subroutines  are  currently  called 
from  system  libraries.  Behavioral  models  could  then  be  easily  incorpo¬ 
rated  by  system  modelists  into  their  simulation  models. 


NEED 


Behavioral  simulation  modules  which  can  be  employed  in  a  "plug-in 
manner  for  incorporation  into  system  models. 


METHOD 


TIME  PHASE 


ii 


Required  behavioral  simulation  mod¬ 
ules  are  prioritized.  The  logic 
for  such  modules  is  developed  and 
the  modules  are  programmed.  The 
availability  of  such  modules  is 
publicized  and  descriptive  litera¬ 
ture  is  made  available. 


Mid  to  long  term 


PERSONNEL  REQUIREMENTS 


END  PRODUCTS 


4.0 


person  years 


A  set  of  behavioral  modules  which 
can  be  employed  in  an  off-the- 
shelf  manner  by  developers  of  Army 
system  simulation  models. 


Compatibility  with  Mini/ Micro  Computer  Technology 

As  pointed  out  earlier,  the  mini/ microcomputer  technology  will 
significantly  impact  disciplines  which  rely  on  high  speed  computations. 
It  seems  that  an  analysis  of  this  impact  should  be  completed  relative  to 
behavioral  simulation  models. 


NEED 


Specifications  and  standards  relative  to  behavioral  modeling  within 
the  mini/ microcomputer  technology. 


METHOD 

An  analysis  is  completed  to  deter¬ 
mine  optimum  methods  for  developing 
behavioral  simulation  models/mod¬ 
ules  within  the  mini/microcomputer 
technology. 

TIME  PHASE 

Near  term 

PERSONNEL  REQUIREMENTS 
.75  person  years 

END  PRODUCTS 

A  set  of  standards  and  specifica¬ 
tions  for  behavioral  simulation 
models/modules  which  are  oriented 
towards  user  implementation  on 
mini/microcomputers. 
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